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SUMMARY 


This  report  describes  the  results  of  an  eight  task  study. 
The  effort  was  intended  to  develop  more  accurate  metrics  and  weightings 
to  be  incorporated  into  the  Air  Force  method  (Logistics  Composite  Model 
(LCOM))  for  determining  manpower  and  other  resource  requirements  for 
operational  and  developing  weapon  systems.  The  eight  study  tasks  com¬ 
prising  this  study  were  as  follows: 


Task  I 

Review  of  Related  Research 
(Boeing  document  D1 94-1 0089-1 ) 

Task  II 

Select  Equipment  for  Investigation 
(Boeing  document  0194-10089-1) 

Task  III 

Identify  Parameters  for  Investigation 
(Boeing  document  D1 94-10089-1 ) 

Task  IV 

Identify,  Obtain,  and  Integrate  Study  Data 
(Boeing  document  D1 94-1 0089-1 ) 

Task  V 

Analyze  and  Prioritize  Parameters 
(Boeing  document  0194-10089-2) 

Task  VI 

Maintenance  Metrics  Development 
(Boeing  document  D1 94-1 0089-3) 

Task  VII 

Maintenance  Weightings  Development 
(Boeing  document  D1 94-10089-3) 

Task  VIII 

Analysis  and  Modification  of  Metrics  and  Weightings 
(Boeing  document  0194-10089-4) 

PROBLEM 


The  increased  Air  Force  concern  with  the  rising  cost  to 
support  weapon  systems  currently  in  operation,  as  well  as  those  in 
development  has  created  the  need  for  more  accurate  methods  of  projecting 
maintenance  requirements.  There  are  two  cost  driver  variables  that-are 
generally  understood  by  all.  These  are  the  manpower  and  material  or 
resources  to  maintain  the  weapon  system.  In  a  recent  study  conducted  on 
the  life  cycle  cost  of  the  C-130E  aircraft  (Reference  0)  it  was  deter¬ 
mined  that  labor  accounted  for  70%  of  the  15  year  cumulative  operational 
and  support  cost,  resources  (material)  approximately  18%,  with  the 
remaining  being  attributed  to  fuel  and  base  support.  The  C-130E  exper¬ 
ience  is  typical  of  the  other  systems  in  Air  Force  inventory. 


0  “Life  Cycle  Cost  of  C-130E  Weapon  System"  AFHRL-TR-77-46, 
July  1977. 
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The  major  proportion  of  total  operating  and  support  cost 
incurred  for  labor  and  material  has  developed  considerable  concern  for 
the  manpower  and  resources  required  to  support  weapon  systems  currently 
in  operation,  as  well  as  those  in  development.  A  study  o*  maintenance 
and  reliability  impact  on  system  support  costs  (Reference  Q))  showed 
that  some  .70"  of  the  life  cycle  cost  funds  of  a  new  weapon  system  are 
essentially  committed  in  the  concept  phase  by  initial  planning 
decisions  (Figure  1). 

This  semi -predetermined  expenditure  has  created  the  need 
for  more  accurate  methods  of  projecting  maintenance  and  manpower 
requirements  early  in  the  design  process  so  that  trades  can  be  made  to 
reduce  long  term  resource  demands,  fleeting  this  need  requires  the 
development  of  realistic  predictive  measures  of  maintenance  rates  for 
all  of  the  diverse  equipment  that  makes  up  a  weapon  system. 


Figure  1  SYSTEMS  FUNDS  COMMITTED  BY 
INITIAL  PLANNING  DECISIONS 


In  addition,  the  impact  of  operations  and  environmental  conditions 
need  to  be  identified  to  insure  the  accuracy  of  the  newly  developed 
maintenance  metrics  under  the  diverse  conditions  met  by  fielded  weapon 
systems . 


®  Maintainability/Reliability  Impact  on  System  Support  Costs, 
AFFDL-TR-73-1 52 ,  December  1973. 
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To  date,  the  manpower  and  other  resource  requirements 
essential  to  the  operations  and  support  (O&S)  of  a  weapon  system  have 
been  determined  using  the  traditional  "flying  hours"  and  "sortie  rate" 
measures.  The  deficiencies  of  these  traditional  measures  are  well 
known  and  such  measures  frequently  are  found  to  be  totally  irrelevant 
(e.g.,  maintenance  on  a  gun  subsystem  is  generated  by  factors  like  the 
number  of  rounds  fired,  and  is  not  affected  by  the  number  of  flying 
hours  or  sorties),.  These  traditional  measures  are  also  insensitive  to 
variations  in  operations  and  environmental  conditions  (for  example, 
many  avionics  equipments  may  operate  or  are  cycled  on  the  ground 
greatly  in  excess  of  related  flying  hours  or  number  of  sorties).  The 
present  difficulties  then  lie  in  the  fact  that  the  currently  used 
metrics  do  not  consider  the  inherent  differences  between  the  individual 
subsystems  of  a  weapon  system  and  are  relatively  insensitive  to 
operational  and  environmental  conditions. 

Therefore,  the  objective  of  this  subject  research  was  to 
alleviate  the  above  deficiencies  by  identifying,  determining,  and 
Integrating  those  measurable  weapon  system  parameters  which  are 
necessary  and  sufficient  to  form  more  accurate  metrics  and  weightings 
with  which  to  predict  system  maintenance  demands.  These  metrics  and 
weightings  are  to  be  Incorporated  into  the  Air  Force  Logistics  Composite 
Model  simulation  system. 

The  LCOM  methodology  utilizes  the  simulation  capabilities 
of  large  digital  computers  and  was  evolved  to  practical  use  under 
Project  PSM  77-43  (1124),  "Human  Resources  in  Aerospace  System  Develop¬ 
ment  and  Operations." 

This  simulation  technology  has  been  documented  in  a  series 
of  technical  reports  ( References (J)through (y) ) ,  and  the  technology  has 
been  transitioned  to  the  Air  Force  Management  Engineering  Agency  (AFMEA) 
with  the  Air  Force  Maintenance  and  Supply  Management  Engineering  Team 
(AFMSMET)  as  the  office  of  primary  responsibility  for  the  standardization, 
documentation,  maintenance,  and  further  development  of  the  system's 
master  software.  The  methodology  is  now  being  utilized  by  many  other 
Air  Force  commands  and  agencies  including  Aeronautical  Systems  Division 
(ASD/ENCC),  Air  Force  Test  and  Evaluation  Center  (AFTEC),  Tactical  Air 
Command  (TAC),  Strategic  Air  Command  (SAC),  Military  Airlift  Command 
(MAC),  United  States  Air  Forces  Europe  (USAFE),  and  Pacific  Air  Forces 
(PACAF). 


(3) through© See  Reference  List 
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APPROACH 


The  approach  taken  for  this  study  effort  was  to  identify, 
obtain,  review  and  catalog  a  data  base  consisting  of  related  research 
findings,  and  design,  operations,  maintenance,  and  environmental  data 
for  a  selected  sample  population  of  aircraft  and  equipments  (study 
tasks  I  through  IV).  This  data  base  was  then  analyzed  for  possible 
causal  factors  for  the  expenditure  of  maintenance  resources.  These 
maintenance  impacts  were  structured  parametrically  and  cataloged  for 
future  use  (task  V).  The  detected  maintenance  impacts  were  then 
combined  into  mathematical  maintenance  metric  models  for  each  item  of 
equipment  studied  (tasks  VI  and  VII).  These  models  predict  maintenance 
action  demand  based  on  significant  design,  operational,  and  environ¬ 
mental  factors  which  impact  the  maintenance  of  each  equipment  item. 
Validation  of  the  models  was  performed  through  testing  within  the 
context  of  ICOM  simulations  (task  VIII). 

RESULTS 


The  results  of  this  study  are  recorded  in  the  series  of  four 
Boeing  interim  technical  reports  cited  in  the  task  list  at  the  beginning 
of  this  summary  and  in  this  final  AFHRL  technical  report. 

The  useful  products  resulting  from  the  study  consisted  of: 

(1)  An  extensive  data  base  on  the  common  subsystems  of  Air  Force  aircraft. 
This  can  be  used  as  is  for  follow-on  study  and  comparability  analyses 
for  emerging  weapon  systems  ( Dl 94-1 0089-1 ,  -2,  and  -3).  (3)  Mainte¬ 

nance  metric  mathematical  models  for  30  common  aircraft  subsystems 
(D194-10089-3  and  Final  -5).  These  models  are  useful  for  maintenance 
resource  expenditure  predictions  for  new  aircraft  equipment,  new  basing 
concepts,  new  operational  scenarios,  and  LOOM  simulation  studies. 

(4)  Trial  LOOM  validation  experiments  using  the  new  metrics  which 
demonstrate  the  methodology  and  provide  confidence  measures  for  future 
users  (0194-10089-4  and  Final  -5). 
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PREFACE 


This  technical  report  is  the  last  in  a  series  of  five 
technical  reports  under  Phase  I  and  II  of  Contract  No.  F33615-77-C-0075, 
Development  of  Maintenance  METRICS  To  Forecast  Resource  Demands  of 
Weapon  Systems: 


Interim  Report  I:  Boeing  Document  D1 94-1 0089-1  , 

Analysis  and  Evaluation 

Interim  Report  II:  Boeing  Document  D1 94-10089-2 , 

Parameter  Prioritization 

Interim  Report  III:  Boeing  Document  D1 94-1 0089-3 , 

Maintenance  Metrics  and  Weightings 

Interim  Report  IV:  Boeing  Document  D194-10089-4, 

Analysis  and  Results  of  Metrics 
and  Weightings 

Final  Report:  Development  of  Maintenance  Metrics 

To  Forecast  Resource  Demands  of 
Weapon  Systems,  D1 94-1 0089-5 

Interim  Reports  I,  II,  III,  and  IV  are  published  as  Boeing 
Aerospace  Company  reports  and  are  filed  with  the  government's  Defense 
Technical  Information  Center  (DTIC). 

Data  emanating  from  this  contract,  "Development  of  Mainte¬ 
nance  METRICS  To  Forecast  Resource  Demands  of  Weapon  Systems,"  are 
reported  in  the  above  series  of  four  Boeing  interim  technical  reports 
and  this  AFHRL  final  technical  report.  Phase  I  of  the  study  provided 
the  identification  of  aircraft  avionic  and  engine  maintenance  resource 
demands,  design  characteristics,  operational  factors,  maintenance 
factors,  and  environmental  factors  which  were  used  to  develop  more 
accurate  metrics  and  weightings  for  incorporation  into  the  Air  Force 
Logistics  Composite  Model  (LC0M).  Phase  II  of  the  study  provides 
metrics  and  weightings  for  the  rest  of  the  subsystems  making  up  a 
typical  Air  Force  aircraft.  A  contract  addition  provided  for  additional 
metrics  LC0M  validation  experiments  to  demonstrate  the  accuracy  and 
utility  of  the  developed  methodology. 

This  approved  final  technical  report  (TR)  includes  work 
performed  from  1  March  1978  through  30  October  1980. 

This  study  contract  was  performed  by  the  Boeing  Aerospace 
Company  Product  Support/Experience  Analysis  Center  (PS/EAC),  Seattle, 
Washington.  USAF  Contract  F3361 5-77 -C-0075  was  initiated  under 
Exploratory  Development  Area  PMS  77-43  (1124).  Work  was  accomplished 
under  the  direction  of  the  Logistics  Research  Division  of  the  Air  Force 
Human  Resources  Laboratory,  Air  Force  Systems  Command  with  Mr.  Frank 
Maher  as  the  Work  Unit  Scientist  and  Air  Force  Contract  Monitor. 

Experience  Analysis  Center  program  technical  leader  was 
George  R.  Herrold.  Principal  program  analysts  were  Donald  K.  Hindes, 
Gary  A.  Walker,  and  David  H.  Wilson. 
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The  Boeing  Aerospace  Company  wishes  to  express  their 
appreciation  for  the  technical  assistance  and  data  provided  by:  a) 
AFLC  Headquarters,  Aeronautical  Systems  Division,  and  Air  Force 
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AFB,  Ohio,  b)  Air  Weather  Service  (MAC)  Environmental  Technical 
Applications  Center  and  Military  Airlift  Command  Headquarters,  Scott 
AFB,  Illinois,  c)  Air  Force  Europe  Headquarters,  Ramstein  AB,  Germany, 
d)  Air  Training  Command  Headquarters,  Randolph  AFB,  Texas,  e)  Strategi 
Air  Command  Headquarters,  Offutt  AFB,  Nebraska,  f)  Tactical  Air 
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1.0  INTRODUCTION 


The  following  is  a  brief  overview  of  the  eight  major  tasks 
required  to  accomplish  this  study.  Figure  2  shows  the  relationships 
of  these  tasks  and  Figure  3  indicates  the  study  products  resulting 
from  the  accomplishment  of  each  task. 


TASK  I 

TASK  II 

TASK  III 

TASK  IV 

TASK  V 

TASK  VI 

TASK  VII 

TASK  VIII 


Identify,  Obtain,  and  Review  Related  Publications 

-  review  related  studies  and  research  dealing 
with  maintenance  rates  and  causes. 

Select  Equipment 

-  develop  matrices  of  equipment  by  aircraft  type 
in  order  to  select  specific  hardware  sub¬ 
systems  and  equipments. 

Identify  Parameters 

-  identify  maintenance,  hardware,  operational 
environmental,  and  aircraft  general  parameters 
which  would  have  an  impact  on  maintenance  for 
the  subject  subsystems. 

Identify  and  Integrate  Data  Sources 

-  identify,  assemble,  correlate,  and  integrate 
the  data  base  on  the  equipment  selected  in 
Task  II  for  the  related  parameters  being 
considered  in  Task  III. 

Analyzing  and  Prioritizing  Parameters 

-  analyze  the  collected  data  to  define  and 

test  relationships  between  the  study  parameters 
and  maintenance  demand  rates. 

Maintenance  Metrics  Development 

-  develop  metrics  for  quantifying  maintenance 
demand  rates  which  are  computable  with  LOOM 
model s . 

Maintenance  Weightings  Development 

-  develop  weightings,  quantifying  identified 
operational  and  environmental  impacts  upon 
maintenance  demand  rates,  and  combine  with 
the  metrics  developed  in  Task  VI. 

Analysis  and  Modification 

-  analyze  LCOM  model  outputs  which  compare 
current  practice  with  the  newly  developed 
metrics  and  weightings  to  illustrate  the 
relative  accuracy  and  confidence  that  may  be 
expected  when  using  the  new  metrics. 
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FIGURE  2  STUDY  TASKS  FLOW  DIAGRAM 
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FIGURE  3  STUDY  ACTIVITIES  AND  PRODUCTS  BY  MAJOR  TASKS 


! 


Task  I  is  discussed  in  Section  2.0  of  this  report.  Task 
II,  Task  III,  Task  IV,  and  Task  V  are  discussed  in  Sections  3.0,  4.0, 

5.0,  and  6.0  respectively.  Tasks  VI  and  VII  are  covered  in  Section  7.0. 
Task  VIII  is  covered  in  Section  8.0  while  Section  9.0  presents  the 
major  findings,  conclusions,  and  recommendations  which  emerged  from  the 
study.  Selected  detail  instruments  and  products  of  the  various  tasks 
which  would  be  useful  to  users  of  the  methodology  are  included  as 
appendices. 

2.0  IDENTIFY,  OBTAIN,  AND  REVIEW  RELATED  PUBLICATIONS  -  TASK  I 

The  initial  step  undertaken  in  this  study  was  to  establish  a 
method  by  which  to  identify,  obtain,  and  review  applicable  literature. 

The  related  research  and/or  descriptive  studies  covering  aircraft 
weapon  system  maintenance  causes  and  measures/rate  of  occurrences  was 
constrained  to  those  published  within  the  last  ten  years.  This  task 
was  accomplished  along  typical  steps  and/or  analytical  sequences  normally 
performed  when  conducting  a  data  review.  The  five  major  steps,  as 
depicted  in  Figure  4,  were: 

a)  STINFO  Search 

b)  Screen  Indexes 

c)  Review  Literature 

d)  Catalog  Selected  Items 

e)  Develop  Bibliography 

The  results  of  this  process  are  depicted  in  Figure  5  and  may 
be  summarized  as  follows.  The  STINFO  search  produced  over  1200  abstracts 
that  were  screened  to  300  documents  for  acquisition  and  further  study. 
These  then  resulted  in  a  METRICS  Historical  File  and  a  Bibliography  of 
over  100  pertinent  contributors  to  the  study.  Complete  details  and 
data  pertaining  to  Task  I  study  efforts  are  contained  in  Boeing  Interim 
Technical  Report  D1 94-10089-1  (Reference  (Q>).  The  significant  finding 
of  this  task  effort  was  that  no  studies  have  been  done  within  the  last 
ten  years  which  attempted  to  duplicate  the  objective  of  the  maintenance 
metrics  study,  or  which  utilized  methodology  which  was  directly  appli¬ 
cable  to  this  study.  The  bibliography  is  useful,  however,  as  a  source 
of  historical  "lessons  learned"  data  and  as  source  material  for  future 
follow-on  studies,  and  as  the  principle  source  of  maintenance  impact 
parameters  identified  during  the  course  of  Study  Task  III  (See  Section 
4.0). 


<0  "Development  of  Maintenance  Metrics  to  Forecast  Resource  Demands 
Of  Weapon  Systems  (Analysis  and  Evaluation)  D1 94-1 0089-1 , 

June  1979. 
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FIGURE  4  IDENTIFY,  OBTAIN,  AND  REVIEW  RELATED  PUBLICATION  FLOW  -  TASK  1 


GOVERNMENT 


FIGURE  5  SUMMARY  OF  TASK  I 


2.1 


STINFO  SEARCH 


The  STINFO  Search  was  conducted  through  the  Boeing  Aerospace 
Technical  Library  which  has  the  capability  of  searching,  effectively 
and  efficiently,  other  technical  libraries,  data  banks,  and  information 
repositories.  The  search  was  keyed  via  descriptive  words  that  most 
aptly  conveyed  the  objectives  of  this  study.  Any  and  all  media,  i.e., 

technical  reports,  manuals,  etc.  were  considered  for  review. 

2.2  SCREEN  INDEXES 

The  products  of  the  STINFO  Search  were  in  the  form  of  computer 
listings  and  other  types  of  indexes.  These  emanated  from  such  reposi¬ 
tories  as  DOC,  DLSIE,  etc.  which  then  had  to  be  screened,  via  the 
report  title  and  abstract,  and  acquired  if  they  appeared  to  have  direct 
application  to  the  study.  Over  1200  such  abstracts  were  reviewed  which 
resulted  in  approximately  300  documents  being  selected  as  likely  con¬ 
tributing  candidates. 

2.3  REVIEW  LITERATURE 


The  information  was  then  divided  into  five  major  categories; 
i.e.,  maintenance,  hardware  (equipment),  operational,  environmental, 
and  aircraft  general.  Only  documents  that  were  aircraft  weapon  system 
maintenance  cause  and  measure/rate  oriented  were  included  in  each  of 
these  categories.  Also  if  data  on  LCOM/MMM  was  contained  in  the  report, 
it  was  retained.  Although  the  primary  equipment  areas  for  this  phase  of 
the  study  were  engines  and  avionics,  information  on  the  remaining  air¬ 
craft  systems  was  identified  and  cataloged  in  preparation  for  Phase  II. 
Over  100  reports  passed  this  screen.  For  simplicity  all  historical 
information,  regardless  of  form,  will  be  henceforth  referred  to  as  a 
document. 

An  interesting  fact  emerged  from  this  literature  search  in 
that  no  published  documents  were  similar  or  duplicated  the  work  being 
done  in  this  study. 

2.4  CATALOGING 

To  aid  in  the  retention  and  subsequent  retrieval  of  the  docu¬ 
ments  for  analysis  in  future  tasks,  a  computerized  log  form  was  developed. 
This  form.  Figure  A-l,  located  in  Appendix  "A,"  not  only  provided  a 
systematic  method  of  building  the  METRICS  Data  File  but  it  allowed  the 
investigators  to  more  efficiently  screen  and  identify  the  useful 
content  of  a  given  document  that  may  be  required  in  an  analysis  task. 

More  than  300  documents  were  reviewed  in  this  manner. 

A  total  of  seventeen  fields  are  available  on  the  log  form  for 
coding/ indexing  the  pertinent  factors  of  a  document  to  describe  its 
characteristics.  Descriptions  of  these  fields  are  also  included  in 
Appendix  "A." 
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2.5 


BIBLIOGRAPHY 


As  mentioned  in  2.3  above,  approximately  one  hundred  docu¬ 
ments  were  screened  out  and  assembled  into  the  Maintenance  Metrics 
Reference  File  to  serve  as  a  source  of  "lessons  learned,"  candidate 
maintenance  impact  parameters,  and  source  data  for  follow-on  studies. 
The  contents  of  this  file  are  accessible  through  the  reference  biblio¬ 
graphy  contained  in  Boeing  Interim  Technical  Report  D1 94-10089-1 
(Reference^) . 
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3.0  SUBSYSTEM  EQUIPMENT  SELECTION  -  TASK  II 


In  order  to  scope  the  study  aircraft  and  subsystem  equipment 
selection  to  the  resources  and  time  available  for  the  study,  an  examina¬ 
tion  of  the  subsystem  equipment  configurations  was  made  across  a 
representative  population  of  current  Air  Force  aircraft.  This  examina¬ 
tion  was  limited  to  Air  Force  aircraft  currently  in  the  inventory  for 
which  current  operational  data  was  available  or  could  be  obtained  from 
on-site  visits.  The  subsystem  equipment  selection  task  was  divided  into 
a  set  of  sub-tasks  sequentially  organized  as  presented  in  Figure  6. 

The  following  subsections  detail  the  approach  and  subsystem  equipment 
selection  process. 

The  subsystem/equipment  selection  process  resulted  in  the 
selection  of  seven  study  aircraft,  30  standard  aircraft  subsystems, 
and  463  representative  equipment  items  within  these  subsystems.  These 
equipments  were  used  as  the  subjects  of  the  parametric  maintenance 
resource  demand  follow-on  analysis.  They  were  selected  to  represent 
a  wide  variation  in  equipment  types,  design  technology,  parts  size, 
complexity,  maturity  states,  usage  in  different  aircraft/mission  types 
and  operational  and  environmental  conditions.  Complete  details  and 
data  pertaining  to  Task  II  study  efforts  are  contained  in  Boeing 
Interim  Technical  Report  D1 94-10089-1  (Reference  ©  ). 

3.1  IDENTIFY  STUDY  AIRCRAFT 

A  preliminary  list  of  candidate  aircraft  was  compiled  consider¬ 
ing  the  following  criteria: 

a)  Representative  aircraft  of  various  types  currently  in  the 
Air  Force  inventory,  i.e.,  bomber,  cargo/transport,  fighter,  trainer, 
and  attack. 

b)  Wide  range  of  operational  commands  (usage)  and  different 
environments  represented  by  selected  aircraft,  i.e.,  different  missions 
and  operating  locations  across  various  types  of  aircraft. 

c)  Wide  range  of  avionic  subsystems  and  engine  applications 
with  different  complexity,  packaging,  and  maturity  represented  within 
the  selected  aircraft. 

d)  Sufficient  data  sample  size  available  for  credible  analysis. 

The  list  of  candidate  aircraft  originally  compiled  consisted 
of  14  different  types  of  aircraft  at  over  30  locations,  and  after 
applying  the  above  mentioned  aircraft  selection  criteria  the  list  was 
narrowed  down  to  seven  different  types  of  aircraft  at  nine  locations. 
Table  1  presents  the  selected  aircraft  in  terms  of  aircraft  type,  model, 
series,  and  the  selection  criteria  discussed  above. 
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IDENTIFY  ICON 

networks  to 


-  SUBSYSTEM  EQUIPMENT  SELECTION  ACTIVITY  FLOW 


3.2  DEVELOP  SUBSYSTEM/EQUIPMENT  SELECTION  CRITERIA 

The  initial  subsystem  equipment  selection  criteria  were 
developed  early  in  the  study  and  were  expanded  during  the  accomplish¬ 
ment  of  Task  I  Literature  Review.  The  selection  criteria  utilized 
during  the  actual  subsystem  equipment  selection  process  are  as  follows: 

a)  Equipment  selected  should  be  functionally  representative 
of  a  wide  cross-section  of  aircraft  applications  and  use  environments. 

b)  Equipment  selected  should  represent  a  wide  variation  in 
type,  i.e.,  design  technology  (new-old),  electrical /mechanical ,  parts 
count/complexity,  maturity  states,  testability,  and  usage. 

c)  Packaging  and  design  technology  must  be  projectable  into 
the  future  to  prevent  obsolete  technology  from  unduly  biasing  statistical 
relationships  which  will  be  used  for  future  predictions. 

d)  Equipment  must  be  mature  enough  for  data  samples  to  be 
taken  beyond  the  learning  curve  period,  yet  include  relatively  new  and 
old  equipment. 

e)  Equipment  must  have  a  statistically  valid  population  of 
operational  units  in  use. 

f)  The  equipment  must  have  sufficient  historical  data  avail¬ 
able  for  valid  analysis. 

g)  Equipment  selected  should  represent  a  significant  percentage 
of  the  total  maintenance  resources  expenditure  demands,  i.e.,  mainte¬ 
nance  manhours,  failures,  removals,  costs,  etc. 

h)  Equipment  should  be  of  a  nature  for  which  factors  other 
than  just  flying  hours  mav  contribute  to  their  reliability/maintain¬ 
ability  characteristics. 

i)  Equipment  selected  should  fit  within  the  functional  grouping 
of  the  LOOM  network  to  be  utilized  during  Task  VIII  -  Analysis  and 
Modification. 

3.3.  IDENTIFY  SUBSYSTEM/EQUIPMENT  APPLICATIONS  BY  TYPE  AIRCRAFT 


The  next  logical  process  was  to  develop  an  aircraft  versus 
subsystem  application  matrix  identifying  the  aircraft  subsystems.  This 
was  accomplished  by  detail  review  of  each  system  in  the  applicable 
aircraft  work  unit  code  (-06)  technical  orders.  Six  hundred  sixty  three 
individual  equipment  items  were  examined  during  this  review. 
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3.4 


SELECT  SUBSYSTEM  EQUIPMENTS 

Prior  to  selection  of  the  study  subsystem  equipments,  it  was 
necessary  to  review  the  LCOM  networks  available  on  the  seven  study 
aircraft  and  determine  which  aircraft/LCOM  networks  would  be  utilized 
to  perform  Task  VIII  -  Analysis  and  Evaluation  effort.  This  was 
necessary  to  insure  that  selected  equipments  would  fit  functionally 
within  the  subsystem  structure  of  the  LCOM  network  to  be  utilized.  This 
review  and  coordination  with  the  AFHRL  contract  monitor  resulted  in 
selection  of  the  Tactical  Air  Command  (TAC)  F-15A  LCOM  network  as  the 
baseline  configuration. 

Utilizing  the  663  equipments  identified  above,  the  follow¬ 
ing  sequential  step  by  step  subsystem  equipment  selection  process  was 
accomplished: 

a)  First,  in  order  to  reduce  the  large  amount  (663)  of 
equipment  items  down  to  a  manageable  number  for  the  study,  those 
systems/subsystems  that  showed  up  on  less  than  five  of  the  seven  study 
aircraft  were  eliminated. 

b)  Identified  all  F-15A  subsystems  contained  in  the  TAC  F-15A 
LCOM  network. 

c)  Identified  the  functionally  equivalent  subsystems  or 
similar  equipment  groupings  within  the  other  six  study  aircraft. 

d)  Identified  and  listed  all  work  unit  codes  (at  the  four  or. 
five  digit  level  as  appropriate)  for  each  of  the  subsystem/equipment 
functional  groupings  identified  in  b  and  c  above. 

e)  Determined  the  number  of  failures  reported  against  each 
of  the  work  unit  codes  within  each  of  the  subsystem  functional  group¬ 
ings  from  b  and  c  above. 

f)  Totaled  the  number  of  failures  within  each  subsystem 
functional  groupings  and  computed  what  percentage  of  the  subsystem 
functional  grouping  total  the  failures  for  each  work  unit  code 
represented. 

g)  Selected  the  work  unit  code(s)  within  each  subsystem 
functional  grouping  on  each  aircraft  that  represented  the  top  failure 
percentage  (50™  or  greater)  of  the  total  failures  within  the  subsystem. 

h)  Compared  common  functions  of  the  subsystem  equipments 
selected  on  each  aircraft  and  made  minor  adjustments  as  necessary  to 
insure  that  functional  equivalent  or  similar  subsystem  equipments  were 
selected  across  each  study  aircraft. 
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Table  2  depicts  the  subsystems/functional  groupings  of  equip¬ 
ment  items  selected  across  the  seven  study  aircraft  arrayed  by  each 
study  phase.  As  reflected  in  Table  2,  all  of  the  engine  subsystems 
were  rolled  up  to  the  two  digit  level  of  the  work  unit  code  structure 
and  the  complete  propulsion  system  is  considered  as  one  equipment  item 
on  each  aircraft.  This  was  necessary  as  the  F-15A  LCOM  network  is 
structured  utilizing  the  same  process.  All  other  subsystem  equipments 
on  all  seven  aircraft  are  structured  at  the  work  unit  code  three  digit 
level  or  lower  (four  or  five  digit  level). 
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4.0  PARAMETER  IDENTIFICATION  -  TASK  III 


The  identification  and  screening  process  for  potential  mainte¬ 
nance  resource  demand  (MRD)  and  maintenance  impact  parameters  associated 
with  the  selected  subsystems/equipments  is  depicted  in  Figure  7.  The 
identification  and  selection  of  appropr  ite  parameters  or  variables 
required  detailed  review  of  the  var  is  parameters  and  variables  identi¬ 
fied  in  other  related  studies  to  determine  usefulness,  types  of  input 
variables  required,  source,  and  availability  of  the  necessary  input 
data.  The  documentation  "i 1 e  assembled  dur  ng  Task  I  (Section  2.0)  was 
utilized  for  this  purpose. 

The  parameter  identification  task  resulted  in  193  significant 
and  collectable  parameters  being  selected  for  use  in  the  follow-on 
study  tasks.  Complete  details  including  a  list  of  the  study  parameters 
selected  and  their  data  values  pertaininq  to  Task  III  and  IV  study 
efforts  are  contained  in  Boeing  Interim  Technical  Report  Dl 94-1 0089-1 
( Reference  o>. 

4.1  PARAMETER  IDENTIFICATION 


The  investigation  and  identification  of  appropriate  parameters 
relied  heavily  upon  the  previous  work  conducted  during  Task  I  - 
"Review  of  Related  Publications"  (Section  2.0)  and  Task  II  -  "Subsystem 
Equipment  Selections"  (Section  3.0).  These  related  study  documents 
were  reviewed  and  all  potential  study  parameters  identified  for  each  of 
the  following  six  major  categories r  (1)  maintenance  resource  demands, 
(2)  operational,  (3)  maintenance,  (4)  environmental,  (5)  hardware/ 
equipment  (subdivided  into  avionics,  engine,  and  other),  and  (6) 
aircraft  general. 

4.2  PARAMETER  SELECTION 


During  the  parameter  investigation  and  identification  process, 
all  possible  parameters  or  variables  were  identified  and  categorized 
into  the  six  major  categories  discussed  above.  The  parameter  selection 
process  was  then  based  on  selecting  only  those  parameters  or  variables 
that  passed  the  selection  criteria  as  follows: 

a)  Useful  -  The  parameter  or  variables  had  to  have  a 
possibility  of  being  sensitive  to  the  maintenance  resource  demand 
requirements  of  the  subsystem(s) /equipments  that  were  being  studied; 

b)  Source  of  Information  -  There  had  to  be  an  identifiable 
source  of  information  required  for  the  parameter  or  variables;  and 

c)  Availability  of  Information  -  The  necessary  information 
for  use  of  the  parameter  or  variables  had  to  be  available  to  the  study 
team  based  on  need  to  know  requirements. 
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FIGURE  7  -  TASK  III  PARAMETER  IDENTIFICATION  ACTIVITY  FLOW 


Based  on  the  above  selection  criteria,  a  total  of  193  individual 
parameters  were  selected  within  the  six  major  categories.  Tables  3 
through  10  list  the  parameters  in  each  of  these  categories.  Table  3  is  a 
list  of  dependent  maintenance  resource  demands.  Tables  4  through  10  are 
lists  of  independent  parameters  in  the  various  categories  which  were 
selected  as  candidate  maintenance  impact  parameters. 


TABLE  ]  MAINTENANCE  RESOURCE  OEHAND  (MRD)  PARAMETERS 


Virhble 

1.0. 

*uW>«r  Late]  Name 

*01  Maintenance  Action  Demand  per  Aircraft 

*02  Equipment  Total  Maintenance  Panhcur  per  Aircraft 

*03  Equipment  Total  Unscheduled  Removals  per  Aircraft 

*04  Equipment  Ground  Aborts  per  Aircraft 

*05  Equipment  Air  Aborts  per  Aircraft 

*06  Equipment  Cannibil iaations  per  Aircraft 


TABLE  4  OPERATIONAL  PARAMETERS 


Variable 

t.D. 

Number  Label  Name 


001 

002 

00! 

004 

005 

006 

007 

008 

009 

010 

Oil 

012 

013 

014 

015 

016 

017 

018 

019 

020 

021 

022 

023 

024 

025 

026 

027 

023 

029 

030 

031 

032 

033 

034 

035 


Maintenance  Action  Demand  per  Aircraft 

Tears  Aircraft  Have  Been  on  Base 

Average  Mission  Mrs 

Aircraft  Grounded  Time 

Average  Joke-Off  Speed 

Median  Take-Off  Distance 

Percent  of  Maximum  Take-Off  Weight 

Average  Climb  Rate 

Averaae  Cruise  Soeed 

Average  Cruise  Altitude 

Average  Descent  Rate 

Average  Landing  Speed 

Minimum  Landing  Distance 

Average  Landing  Weight 

Total  Flying  Hours  per  Aircraft 

Training  Flying  Hours  Per  Aircraft 

Operations  Flying  Hours  per  Aircraft 

Mlsc.  Flying  Hours  per  Aircraft 

Total  Landings  per  Aircraft 

Training  Landings  per  Aircraft 

Operations  Landings  per  Aircraft 

Mlsc.  Landings  per  Aircraft 

Average  Numcer  of  Aircraft  on  Alert 

Average  Number  of  Deployed  Aircraft 

Total  Sorties  per  Aircraft 

Training  Sorties  per  Aircraft 

Operations  Sorties  per  Aircraft 

Misc.  Sorties  per  Aircraft 

Average  Possessed  Aircraft 

Maximum  Aircraft  Speed 

Maximum  Aircraft  Ceiling 

Aircraft  Crew  Size 

Average  Sortie  Length 

Accfdents  (Kajor/MinorJ  per  Aircraft 

Incidents  per  Aircraft 
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Variable 

1.0. 

Njnber 

MOl 

H02 

M03 

MQ4 

M05 

M06 

M07 

me 

M09 

M10 

MU 

MU 

M13 

MIA 

M15 

M16 

M17 

MIS 

M19 

WO 

M21 

K22 

K23 

H24 

N2S 

M26 

W7 

K28 

N29 

M30 


Varl able 
1.0. 
Number 

EOl 

£02 

£03 

E04 

EOS 

E06 

E07 

EOS 

E09 

E10 

Ell 

E12 

E13 

£14 

E15 

E16 

E17 

E18 

E19 

£20 

E21 

£22 

E23 

E24 

£25 

E2S 

E27 

£28 

E29 

£30 

£31 


TA3L£  S  MAINTENANCE  PARAMETERS 


Label  Nan* 


Maintenance  Action  Demand  per  Aircraft 
Average  OR  Rate 
Average  NORM  Rate 
Average  NORS  Rate 

Total  Maintenance  Personnel  Authorized 

Total  Maintenance  Personnel  Assigned 

Total  3  Level  Maintenance  Personnel  Assigned 
Total  5  Level  Maintenance  Personnel  Assigned 
Total  7  Level  Maintenance  Personnel  Assvgned 
Total  9  Level  Maintenance  Personnel  Assigned 
Total  Maintenance  Personnel  Authorized  (AMS) 

Total  Maintenance  Personnel  Assigned  (AMS) 

Total  3  Level  Maintenance  Personnel  Assigned  (AMS) 
Total  S  Level  Maintenance  Personnel  Assigned  (AMS,' 
Total  7  Level  “amtenaoce  Personnel  Assigned  (AMS) 
Total  9  Level  Maintenance  Personnel  Assigned  AMS ) 
Total  Maintenance  Manhours  Expended  per  Aircraft 
AMS  Maintenance  Manhours  Expended  per  Aircraft 
Maintenance  Conceot 
Average  Turn-Around  Time  -  Maintenance 
Aircraft  F00  (All  Causes) 

Total  Oeneral  Supoort  (01-09)  Manhours  Per  Aircraft 
Total  General  Support  -  01  Manhours  per  Aircraft 
Ground  Handling  and  Servicing 
Total  General  Support  -  02  Manhours  per  Aircraft 
Aircraft  Cleaning 

Total  General  SuPPorC  -  03  Manhours  per  Aircraft 
Look  Phase  of  Scheduled  Inspections 
Total  General  Support  -  04  Manhours  per  Aircraft 
Special  Inspections 

Total  General  Support  -  OS  Mannours  per  Aircraft 
Preservation  and  Storage 

Total  General  Support  -  06  Manhours  per  Aircraft 
Arming  and  Disarming 

Total  General  Suoport  -  07  Mannours  per  Aircraft 
Preparation  and  Maintenance  of  Records 
Total  Genera!  Support  -  09  Manours  per  Aircraft 
In-Shop  General  Support 


TABU  «  ENVIRONMENTAL  PARAMETERS 


Label  Na.ie 


Maintenance  Action  Demand  per  Aircraft 

8ase  A! ti tude 

Runway  Direction 

Oistance  to  Mountains 

Oirection  of  Mountains 

Number  of  Snow  Oays 

Total  Snow  Fall 

Mean  Snow  Depth 

Number  of  Rain  Days 

Total  Rain  Fall 

Number  of  Hail  Oays 

Relative  Humidity  (Averaoe) 

Number  of  Thunder  Oavs 

Number  of  Sleet  Days 

Number  of  Fog  Days 

Predominate  Hind  Oirection 

Maximum  Crosswind's  Less  Than  10  MPH 

Maximum  Crosswird's  10-19  MPH 

Maximum  Crosswind's  20-29  MPH- 

Maximum  Crosswind’s  30-39  MPH 

Maximum  Crosswind's  40-49  MPH 

Maximum  Crosswind's  Greater  Than  50  MPH 

Mean  Temperature 

Mean  Minimum  Temperature 

Mean  Maximum  Temperature 

Oays  Maximum  Temperature  was  Above  80“  *F" 

Days  Minimum  Temperature  was  3e!ow  32°  “F" 

Total  Number  of  Obstructions  to  Vision 

Predominate  Type  of  Obstructions 

Average  Obstruction  Type 

Average  Obstruction  Severity 
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TABLE  7  AVIONICS  PARAMETERS 


Variable 

I.O. 

Number 

AOl 
A02 
AO  3 
A04 
AOS 
A06 
AO  7 
AOS 
A09 
AlO 
All 
A12 
A13 
A14 
A15 
A1S 
A17 
A18 
A19 
A20 
A21 
A22 
A23 
A24 
A2S 
A26 
A27 


Variable 

l.O. 

Number 

POl 
P02 
TO3 
P04 
P05 
P06 
P07 
P08 
P09 
PIO 
PU 
P12 
P13 
P 14 
PIS 
PIS 
P17 
P18 
P19 
P20 
P21 
P22 
P23 
P24 


Label  Name 


Maintenance  Action  Demand  per  Aircraft 
Eduipment  Location  on  Aircraft 
Equipment  Weight 
Equipment  Volume 
SRU  Count 

Operatinq  Temperature 

Cooling  Method 

Protection  Devices 

Number  of  Test  Points  (Org.  Level) 

Required  Age 

Age  Availabi 1 1 ty 

Age  Unrel iaoility 

Average  Operating  Time  per  Sortie 

Failure/Halfunction  Causes 

Retest  OK  Rate 

On-Off  Cycles  per  Flying  Hour 
On-Off  Cycles  per  Sortie 
Ground/FI (gnt  Operating  Ratio 
Failure/Abort  Ratio 
Equipment  Oensity 

Equipment  Total  Maintenance  Manhour  per  Aircraft 
Equipment  Total  Removals  per  Aircraft 
Equipment  Unscheduled  Removals  per  Aircraft 
Equipment  Scheduled  Removals  per  Aircraft 
Equipment  Ground  Aborts  per  Aircraft 
Equipment  Air  Aborts  per  Aircraft 
Equipment  Canmbi  1  izations  per  Aircraft 


TABLE  8  ENGINE  PARAMETERS 


Label  Name 


Maintenance  Action  Demand  per  Aircraft 

Total  Number  of  Installed  Engines 

Take-Off  Thrust  per  Engine 

Weight  oer  Engine 

Volume  oer  Engine 

Density  per  Engine 

Number  Compressor  Sections  per  Engine 

Number  Compressor  Blades  per  Engine 

Turbine  Section  Size 

Maaimum  Engine  Combustion  Temperature 

Maaimum  Enqine  Fuet  Flow 

Minimum  Engine  Fuel  Flow 

Engine  Prime  Ceoot 

Enqine  Age  Availabi I i ty 

Engine  Age  Unreliability 

Engine  Vibration  Factors 

Total  Maintenance  Manhours  per  Installed  Engine 
Total  Engine  Maintenance  Msnnours  per  Aircraft 
Total  Engine  Removals  per  Aircraft 
Unscheduled  Engine  Removals  per  Aircraft 
Scheduled  Enqine  Removals  per  Aircraft 
Engine  Ground  Aborts  oer  Aircraft 
Engine  Air  Aborts  oer  Aircraft 
Engine  Part*  Cannibi 1 ization  per  Aircraft 
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TABLE  9  OTHER  EQUIPMENT  PARAMETERS 


Variable 

I.O. 

Number 

F01 

F02 

F03 

F04 

FOS 

FOB 

F07 

F08 

F09 

F10 

FU 

F12 

FU 

Fl« 

FIS 

FIB 

F17 

F18 

F19 

F20 

F21 

F22 

F23 

F24 


Variable 

1.0. 

Number 

GO  I 
G02 
G03 
G04 
G05 
G06 
GO  7 
G08 
G09 
G10 
GU 
S12 
G13 
G14 
G1S 
GIB 


Label  Name 


Location  of  Equipment  on  the  Aircraft 

Primary  Material  -  Composition  Technology  Level 

Equipment  Weight 

Equipment  Volume 

Operatinq  Temperature 

Support  Equipment  Complexity 

Support  Equipment  Reliability 

Type  of  Failure  Problems 

Inflight  Squawk  Verification  Rate 

On/Off  Cycles  per  Sortie 

Ground  to  Flight  Operating  Ratio 

Relative  Reliability  of  Equipment  Drivino  Force 

Removals  to  Access  Other  Equipment 

Severity  of  F00 

Principle  Failure  Cause 

Equipment  Protection  Methodology 

Equipment  Pressuritation  Level 

Rain  Removal  Technology  (Windshield) 

Mounting  Position 
Power  Rating  (Generators) 

Humber  of  Tire  Ply's  (Tires) 

Landings  per  Tire  (Tires) 

Average  Tire  Cost  (Tires) 

Securing  Method  Technology 


TABLE  10  AIRCRAFT  GENERAL  PARAMETERS 


Label  Name 


Maintenance  Action  Demand  per  Aircraft 

Tears  Since  Aircraft  was  Produced 

Aircraft  Empty  Weight 

Maximum  Gross  Weight  -  Take-Off 

Aircraft  Wing  Area 

Aircraft  Aspect  Ratio 

Total  Fuel  Capacity 

Average  Aircraft  Wing  Load 

Tears  Since  Engine  Production 

Number  of  Installed  Engines  per  Aircraft 

Engine  Weight  per  Aircraft  (All  Engines) 

Total  Thrust  per  Aircraft 

Designated  Climb  Rate 

Number  of  Generator's  per  Aircraft 

Total  Maintenance  Manhour  per  Flight  Hour 

Tears  Since  Aircraft  First  Flight 
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5.0  IDENTIFICATION  ANO  INTEGRATION  OF  DATA  SOURCES  -  TASK  IV 


This  task,  data  base  development,  was  critical  to  the  quality  and 
credibility  of  the  study.  Without  adequate  and  correct  data  for  the 
193  study  parameters  identified  in  Task  III  (Section  4.0),  the  remaining 
tasks  would  be  less  meaningful  as  would  any  analysis  effort  that  employed 
statistics  and  a  computer  model.  Therefore,  additional  emphasis  was 
placed  on  this  task  to  insure  the  accomplishment  of  the  objectives. 

The  total  task  was  logically  divided  into  three  distinct  sub¬ 
tasks;  a)  Identification,  b)  Acquisition,  and  c)  Integration.  Figure  8 
depicts  the  step-by-step  functional  flow  developed  and  the  sub- indentures 
of  each  step. 

The  study  data  base  assembled  by  this  task  effort  consisted 
of  nine  sample  data  values  (one  for  each  aircraft/base  combination 
selected  in  Task  II)  for  each  equipment  related  parameter  (81  in  all) 
for  each  of  the  30  equipment  subsystems  studied  (21,870  data  entries). 

Nine  data  cases  were  also  obtained  for  each  of  the  non-equipment  study 
parameters  such  as  operational  and  environmental.  There  are  112  of 
these  parameters  so  the  resultant  data  base  contains  1008  data  entries 
in  the  non-equipment  categories. 

In  order  to  obtain  and  assemble  the  above  data  base, over 
seven  million  maintenance  transactions  (records)  were  obtained  from 
nine  different  data  systems  and  over  400  supplemental  data  parameters 
acquired  directly  from  on-site  visits  to  eight  operational  bases. 

AFM  66-1  (D056E)  data  for  seven  aircraft  was  processed  per  LOOM 
criteria  into  easily  readable  multi-WUC-digit  formats  in  preparation 
for  follow-on  detail  analysis.  Complete  details  and  data  pertaining 
to  Task  IV  study  efforts  are  contained  in  Boeing  Interim  Technical 
Report  D1 94-1 0089-1  (Reference 

5.1  IDENTIFICATION  OF  DATA  SOURCES 


The  identification  of  data  sources  and  the  types  of  data  each 
source  was  responsible  for,  or  was  the  historical  repository  of,  covered 
three  primary  areas;  a)  Air  Force  Agencies,  b)  Operating  Wings,  and  - 
c)  EAC  Historical  Data  Files.  Table  11,  "Data  Sources  and  Agencies" 
lists  the  major  command,  center  or  base;  geographical  location; 
specific  office  or  wing  where  data  was  obtained;  and  the  general  type 
of  available  data.  The  various  categories  of  information  and  detail 
data  elements  (parameters,  aircraft,  bases,  and  equipments)  were 
established  in  the  preceding  tasks. 

5.2  DATA  ACQUISITION 

Once  the  various  sources  and  their  respective  types  of  data 
had  been  established  the  next  logical  step  was  to  obtain  data  that  was 
not  currently  in  the  EAC  Historical  Data  Bank  or  to  obtain  an  update  of 
more  current  information.  Since  this  study  was  initiated  in  early  1978, 
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FIGURE  8  -  IDENTIFICATION  AND  INTEGRATION  OF 
DATA  SOURCES  -  TASK  IV  -  FLOW  DIAGRAM 
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AGENCY  BASE  LOCATION  OFFICE  SYMBOL/ FUNCTION  OR  WING  TYPE  OF  DATA 


the  most  recent  data  that  would  be  available  from  the  various  reposi¬ 
tories  was  1977.  Therefore,  since  1977  was  a  typical  year  in  peacetime 
Air  Force  operations,  it  was  chosen  as  the  base  period  for  study  data 
base  development.  Many  of  the  parameters  used  in  the  study  fluctuate 
with  time.  However,  when  averaged  over  a  typical  year's  operation, 
value  drift  is  not  great.  Over  many  years  operations  values  can 
vary  significantly  as  is  dramatically  portrayed  in  Reference  0  on  the 
C-130E  aircraft  since  many  of  the  same  data  elements  are  common. 
Therefore,  follow-on  research  in  this  study  area  would  do  well  to 
consider  the  effect  of  averaging  several  year's  data. 

In  obtaining  the  specific  data  types,  the  task  logically 
divided  into  computer  generated  type  information  and  data  that  must  be 
obtained  from  an  on-site  survey. 

5.2.1  COMPUTER  GENERATED  DATA 

Although  all  tne  data  obtained  in  this  study  was  eventually 
computer  manipulated,  in  one  form  or  another,  the  following  discussion 
pertains  only  to  that  data  received  on  magnetic  tape. 

5. 2. 1.1  AFM  66-1  (0056E)  -  Maintenance  Management  Data 

For  the  seven  study  aircraft  all  AFM  66-1  data  had  been 
previously  processed  for  1977  except  the  T-38A.  This  had  to  be 
ordered  through  the  Air  Force  Systems  Command  (AFSC)  via  AFLCR/ 

AFSCR  178-6  and  processed.  A  total  of  over  five  million  records  or 
maintenance  transactions  were  either  previously  available  or  obtained 
on  the  subject  aircraft. 

5. 2. 1.2  G033B  -  Standard  Aerospace  Vehicle  Inventory,  Status 

and  Utilization  Reporting  System 

This  system  provided  the  operational  parameters  necessary 
for  various  rates,  such  as  maintenance  manhours  per  flight  hour, 
utilization,  etc.  as  well  as  the  operational  ready  and  not  opera¬ 
tional  ready  rates  per  specific  categories. 

5. 2. 1.3  D041  -  Recoverable  Consumption  Item  Requirements  System 

D097  -  Interchangeable ity  and  Substitution  Data 
Maintenance  System 

H036B  -  DMIF  Cost  Accounting/Production  Report 

These  three  data  systems  comprised  the  depot  data  used  in 
various  trades  made  during  equipment  selection  and  verification.  The 
two  million  plus  records  contained  such  significant  parameters  as 
equipment  cost,  maintenance  flow  time  through  base  and  depot,  and 
maintenance  manhour  expenditures. 

®  "Life  Cycle  Cost  of  C-130E  Weapon  System,"  Ibid. 

37 

D1 94-1 0089-5 


5. 2. 1.4  B-4/C-4  -  Reference  Data  Tapes 


These  tapes,  although  not  supplying  any  investigative 
parameters  per  se,  are  critical  in  tracking  a  given  aircraft  component 
from  AFM  66-1  to  depot  data.  They  contain  cross  references  to 
part  number,  work  unit  code,  and  national  stock  number. 

5. 2. 1.5  Environmental 


This  information,  obtained  from  ETAC,  represents  the  computer¬ 
ized  weather  information  for  each  of  the  eight  bases  visited.  These 
included  such  parameters  as  snow  fall,  rain  days,  humidity,  etc. 

5.2.2  ON-SITE  SURVEY  BY  BASE  VISITS 


As  in  any  data  acquisition  task  of  this  magnitude,  all  the 
necessary  parameters  have  not  been  computerized.  This  necessitates  on¬ 
site  visits  to  obtain  the  data.  Not  only  does  it  fill  in  the  missing 
parameters  but  it  serves  to  validate  the  processed  data.  An  equally 
important  function  is  the  establishment  of  data  parameter  specialists 
or  points  of  contact  that  can  be  consulted  with  during  the  detail 
analysis  of  the  data. 

5. 2. 2.1  AUTHORIZATION  LETTER 

To  visit  any  operational  unit,  authorization  was  required 
from  the  respective  command.  Appendix  B  shows  a  typical  letter  used 
that  included  the  following  pertinent  items: 

a)  Contract  Number  and  Name 

b) '  Introduction 

c)  Objective 

d)  Assistance  required  and  point  of  contact 

e)  Authorizing  signatures 

It  is  imperative  that  these  be  forwarded  well  in  advance 
of  the  intended  time  of  visit  to  allow  for  any  contingencies  that  may 
occur  at  the  base.  Not  only  did  this  procedure  work  satisfactorily, 
throughout  the  entire  study  but  the  points  of  contact  were  contacted 
immediately,  once  known,  and  again  a  week  prior  to  the  visit.  This 
personal  contact  eliminated  any  last  minute  problems  and  established 
an  excellent  rapport  with  the  base  personnel. 

5. 2. 2. 2  DATA  ACQUISITION  FORM 

Prior  to  traveling  to  any  base,  a  series  of  forms  (see 
example  in  Appendix  C)  were  developed  listing  the  specific  data 
parameters  or  narrative  information  desired  by  function,  i.e.,  avionics, 
engines,  fuel,  hydraulics,  etc.  These  forms  proved  to  be  invaluable  in 
that  they  provided  a  consistent,  systematic  approach  at  each  base.  These 
were  distributed  to  the  respective  technicians,  where  practical,  and 
proved  to  be  the  most  economical  and  expeditious  method  to  gather  all  the 
data. 

38 

D1 94-10089-5 


1 


5. 2. 2. 3  BASE  VISITS 

At  each  base  depicted  in  Figure  9,  it  was  necessary  to 
visit  six  major  areas.  The  first  and  most  significant  was  the  DCM 
Office.  Here  a  short  introductory  presentation  was  given  to  all 
functional  OIC's/NCOIC's  from  which  data  was  required.  This  one 
time  meeting  set  the  stage  for  a  smooth  transition  of  data  flow  with 
all  concerned  namely: 

a)  Operations  -  The  DCO  or  standardization  pilot  covered 
the  aircraft  characteristics. 

b)  Weather  -  Base  weather  provided  obstructions  to 
vision  by  month. 

c)  Analysis  -  Monthly  maintenance  summaries  and  support 
general  data  via  a  BUS  printout. 

d)  Quality  Control  (QC)  -  QC  answered  general  type 
questions  on  aircraft  maintenance. 

e)  Avionics  Maintenance  Squadron  (AMS)  -  AMS  provided  the 
data  for  all  avionics  equipments. 

f)  Field  Maintenance  Squadron  (FMS)  and  Organizational 
Maintenance  Squadron  (OMS)  -  FMS  and  OMS  provided  the 
data  for  engines  and  all  other  non-avionics  equipments. 

5.3  DATA  INTEGRATION 

This  third  and  final  step  of  Task  IV  was  primarily  a  continua¬ 
tion  of  data  preparation  for  analysis  in  the  ensuing  tasks.  The  AFM 
66-1  maintenance  expenditure  records  (D056E)  had  to  be  screened  and 
integrated  into  an  LCOM  acceptable  format. 

To  accomplish  this  screening,  computer  programs  were  written 
to  manipulate  the  data  per  the  Common  Data  Extraction  Program  (CDEP) 

User  Documentation  (Reference  0  )  specification.  This  criteria  was 
followed,  without  deviation,  since  it  would  provide  the  same  data  as 
is  currently  being  used  by  LCOM  analysts. 

Although  these  Boeing  developed  LCOM  data  programs  used  CDEP 
criteria, the  output  format  was  unique  to  the  requirements  of  this  study. 
Each  ‘LCOM  Action  Code1  (Reference  Q  ),  was  displayed  by  study  aircraft 
with  the  following  data  elements. 


(JJ  "Coirmon  Data  Extraction  Program  (CDEP)"  AFMSMET,  March  1978. 
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a)  WUC  at  all  indentures  (2,  3,  4,  5). 

b)  Units  produced  count 

c)  JCN  count  (summation  of  different  JCN's) 

d)  Manhours 

e)  Clockhours 

Table  12  is  a  graphical  display  of  these  indentured  LCOM  type 
actions  for  the  F-15A  at  Luke  AFB. 

The  complete  procedures  developed  consisting  of  30  subsystems 
and  seven  sort  modules  are  described  in  detail  along  with  flow  charts  in 
Boeing  Document  BCS-G1109,  "CDEP  Production  System)  (Reference^  ). 

This  processing  of  AFM  66-1  data  for  the  seven  different 
aircraft  types  commenced  with  approximately  seven  million  records. 
Selecting  only  the  data  for  the  study  aircraft  at  the  bases  visited 
reduced  the  count  to  approximately  1.4  million  records.  Also,  the 
flight  time  and  number  of  aircraft  in  the  data  sample  was  reduced  from 
826,823  flight  hours  and  1,695  aircraft  to  135,835  and  362  respectively. 

Completion  of  this  data  processing  for  each  aircraft  at  each 
base  and  the  supplemental  data  obtained  from  the  acquisition  phase 
(letters  and  on-site  visits)  provided  a  substantial  data  base  of  varied 
parameters  for  the  follow-on  analysis  tasks. 


(0  8oeing  Document  BCS  "CDEP  Production  System,"  February  1979. 
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TABLE  12  LCOMized  AFM  66-1  DATA  FORMATS 
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6.0  ANALYZING  AND  PRIORITIZING  PARAMETERS  -  TASK  V 

Task  V  of  the  study  was  to  perform  an  analysis  of  the  field 
experience  data  base  accumulated  by  the  first  four  study  tasks.  The 
objective  of  the  analysis  was  the  detection,  testing  and  ranking  of 
possible  statistically  useful  causal  relationships  between  the  candidate 
maintenance  impact  parameters  (See  Tables  4  through  10,  section  4)  and 
maintenance  resource  demand  variables  (See  Table  3,  section  4)  selected 
in  Task  III.  If  new  st-ong  relationships  were  detected  for  each  equip¬ 
ment  type  studied,  then  these  basic  two  variable  parametrics  could  be 
used  to  build  composite  maintenance  demand  models  (Maintenance  Metrics) 
during  the  course  of  Tasks  VI  and  VII. 

The  general  Task  V  approach  divided  the  analysis  into  sub¬ 
tasks  as  shown  in  Figure  10.  The  preparation  and  execution  of  these 
subtasks  are  discussed  in  the  following  paragraphs.  This  approach  is 
deliberately  intended  as  a  generalized  step-by-step  outline  of  the 
methodology  involved  so  that  cither  studies  can  duplicate  and/or  expand 
the  research  using  widely  available  computerized  statistical  packages 
such  as  "SPSS"  (Reference©),  and  "STATPK"  (Reference©)-  The 
analysis  as  performed  by  Boeing  Experience  Analysis  Center  utilized  a 
Boeing  developed  computer  program,  "PKING,"  which  automatically  combined 
several  subtasks  in  order  to  facilitate  and  speed  up  the  parametric 
relationship  detection  and  testing  process.  Utilizing  this  local 
program  allowed  24,460  variable  combinations  to  be  tested  within  the 
a'/otted  effort. 

The  Task  V  procedure  was  applied  to  the  quantification  and 
normalization  of  the  source  data  accumulated  during  the  first  four 
tasks,  and  the  tabulation  of  this  data  into  a  Master  Input  Data  File 
suitable  for  computer  input  and  processing.  Processing  the  data  with 
the  "PKING"  crossplotting  and  regression  analysis  program  resulted  in 
the  generation  of  almost  27,000  scattergrams  of  the  eight  selected 
Maintenance  Resource  Demand  (MRD)  parameters  as  functions  of  the  various 
candidate  Maintenance  Impact  Parameters  in  the  categories  of  MRD, 

Equipment,  Operations,  Environmental,  Maintenance,  and  Aircraft  General 
(refer  to  Section  4.0  Tables  3  through  10  for  parameter  list).  These 
scattergrams  were  screened  according  to  the  criteria  of  (1)  0.5  or 
better  correlation  coefficient  of  regression;  or  —  (2)  Visually 
apparent  curvilinear  relationships;  with  —  (3)  Acceptable  data  point 
distribution;  and  --  (4)  At  least  5  data  points,  4  of  which  are  non-zero 
in  both  ordinate  and  abscissa.  The  screening  process  resulted  in  the 
rejection  of  89%  of  the  trial  relationships  tested.  The  remaining  11% 

(2900  scatterorams )  were  collated  in  a  Maintenance  Impact  Estimating 
Relationship  (MIER)  catalog  and  published  as  a  supplement  to  Boeing  report, 

©  "SPSS  Statistical  Package  for  the  Social  Sciences,"  Norman  Nie, 

Dale  H.  Bent,  C.  Hadlai  Hall;  McGraw-Hill  Book  Company,  Inc.,  1970. 

©  BCS-10201-019-R1  "MAINSTREAM-CTS  Interactive  Statistics  Package 
(STATPK),"  Boeing  Computer  Services,  Seattle,  Washington,  March 
1978. 
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FIGURE  10  TASK  V  PROCESS  FLOW 


1 


D1 94-10089-2  (Reference  <Q).  Eight  hundred  forty  eight  (848)  of  these 
relationships  involved  the  MRD  parameter  "Maintenance  Action  Demand" 
as  a  function  of  various  Maintenance  Impact  Parameters.  These 
significant  relationships  were  used  as  source  data  for  the  development 
of  the  maintenance  metrics  models  during  Tasks  VI  and  VII.  The  remain¬ 
ing  MIERs  composed  of  the  other  MRD  functions  have  been  cataloged  in 
the  above-mentioned  supplement  and  are  available  for  future  studies 
and  related  research.  Complete  details  and  data  pertaining  to  Task  V 
study  efforts  are  contained  in  Reference  ©• 

6.1  INPUT  DATA  PREPARATION 


Before  maintenance  resource  demand/maintenance  impact  parameter 
variable  combination  testing  and  screening  could  proceed,  the  packages 
of  data  and  information  gathered  in  Task  IV  were  classified,  quantified 
and/or  normalized  where  necessary,  and  tabulated  in  numerical  data  sets 
suitable  for  computer-aided  cross-plotting  and  simple  regression  analysis 
Figure  11  depicts  the  preliminary  input  data  processing.  Dummy  variables 
were  created  and  scaled  where  necessary  to  quantify  qualitative  data. 
Quantitative  data  were  normalized  or  averaged  where  necessary.  Independ¬ 
ent  and  dependent  trial  regression  variables  were  selected.  As  shown 
in  Figure  11,  the  individual  data  packages  for  the  items  in  each 
functional  equipment  group  (subsystem)  selected  in  Task  II  were 
integrated  into  a  composite  data  package  for  each  group.  Subsystem 
equipment  groups  were  functionally  normalized  across  all  sample  aircraft 
from  Task  II  and  the  parameter  value  data  for  each  equipment  item 
integrated  into  subsystem  group  values  through  a  weighted  average 
process.  These  composite  data  were  next  entered  in  the  Master  Input 
Data  records.  This  master  file  was  then  transformed  to  proper  computer 
input  format  and  entered  in  the  "Keypunch  Master  File"  prior  to  creation 
of  punch-card,  magnetic  tape,  or  magnetic  disk  data  input  files  suit¬ 
able  for  computer  processing.  The  format  Keypunch  Master  File  created 
for  Task  V  was  tailored  for  the  PKING  data  processing  program.  The. 
general  process  for  creating  the  Master  Input  File  is  widely  applicable, 
however,  and  could  be  used  to  create  input  files  for  a  wide  variety  of 
data  processing  programs.  The  detailed  procedure  used  in  quantifying 
and  integrating  the  "raw"  data  base  accumulated  during  Task  IV  is  as 
follows: 


(Q  Boeing  Interim  Technical  Report  "Development  of  Maintenance  Metrics 
to  Forecast  Resource  Demands  of  Weapon  Systems  (Parameter  Priori tiza 
tion)"  D1 94-1 0089-2,  October  1979. 
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6.1.1  MASTER  INPUT  FILE  CREATION 

The  field  experience  data  gathered  during  Task  IV  was  divided 
into  six  categories: 

(1)  Maintenance  Resource  Demand  Parameters 

(2)  Equipment  Characteristics  Parameters 

(3)  Base  Operations  Characteristics  Parameters 

(4)  Base  Environment  Characteristics  Parameters 

(5)  Base  Maintenance  Characteristics  Parameters 

(6)  General  Aircraft  Characteristics  Parameters 

Information  on  each  parameter  in  the  first  two  categories  was  obtained 
for  each  equipment  item  selected  from  each  study  aircraft  at  each  study 
base.  Information  was  obtained  on  an  aircraft/base  basis  for  the  other 
four  categories.  This  information  was  normalized  on  a  subsystem  basis 
as  appropriate  and  entered  into  composite  data  files.  Since  the  data 
in  categories  (1)  and  (2)  were  gathered  on  each  individual  equipment 
item  within  each  functional  grouping  (subsystem),  data  on  these  individual 
equipment  items  required  transformation  into  subsystem  level  values. 

This  was  accomplished  by  a  simple  weighted  average  method  based  on  the 
relative  frequency  of  maintenance  of  the  equipment  items  comprising  a 
particular  subsystem  within  a  particular  study  aircraft  type.  For 
instance,  if  item  A  and  item  B  comprise  functional  subsystem  C  for  a 
particular  aircraft,  and  the  Maintenance  Action  Demand  for  item  A  is 
twice  that  of  item  B  (say  10  actions  per  unit  per  year  vs  5  actions/ 
unit/year),  then  equipment  characteristic  parameter  values  for  item  A 
would  be  weighted  twice  as  heavily  as  B  values  when  calculating  the 
composite  value  of  subsystem  C.  For  example,  if  A's  volume  is  4  cubic 
inches  and  B's  volume  is  7  cubic  inches,  the  weighted  average  volume 
of  subsystem  C  for  maintenance  resource  demand  purposes  is  — 

(4+4+7)  r  3  s  5  cubic  inches.  This  is  the  value  entered  in  the  composite 
data  file  and  represents  the  average  volume  of  items  removed  from  sub¬ 
system  C  that  must  be  dealt  with  by  the  maintenance  system  over  the 
course  of  a  year's  activity.  This  same  type  of  reasoning  was  applied 
to  the  calculation  of  the  composite  values  of  the  other  equipment 
characteristic  parameters. 

Most  of  the  data  in  the  data  base  was  obtained  in  quantitative 
form.  Information  on  a  few  parameters  was  obtained  in  qualitative 
form,  however,  and  required  quantification.  Table  13  shows  an  example  list 
(equipment  characteristics  parameters  -  propulsion)  of  the 
identification  developed  for  each  of  the  parameter  input  data  categories. 
Table  13  shows  the  category  of  parameters,  their  type  (real  or  scaled 
variable),  their  units  of  measure  if  any,  and  the  scaling  conventions 
used  for  variables  which  were  scaled  from  qualitative  data. 
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TABLE  13  EQUIPMENT  CHARACTERISTICS  PARAMETERS 
(PROPULSION)  -  EXAMPLE 


PARAMETER  NAME 

TYPE 

. 

UNITS 

Total  No.  of  Installed  Engines 

Real 

Number/ Acft. 

Take-off  Thrust  Per  Engine 

Real 

Pounds/ 10 

Weight  Per  Engine 

Real 

Pounds/ 10 

Volume  Per  Engine 

Real 

Cu.  Ft./lO 

Density  Per  Engine 

Real 

tb/Cu.Ft./lO 

No.  Compressor  Sections  Per 

Engi ne 

Real 

Number 

No.  Compressor  Blades  Per  Engine 

Real 

Number 

Turbine  Section  Size 

Real 

Ft.  Diam 

Max  Engine  Combustion  Temp. 

Real 

Degrees  "C" 

Max  Engine  Fuel  Flow 

Real 

Lbs/Hr 

Min  Engine  Fuel  Flow 

Real 

Lbs/Hr 

Engine  Prime  Depot 

Scaled 

Convention: 

1  -  0CALC 

2  -  SAALC 

3  3  Teledyne 

4  =  Alameda 

Engine  AGE  Availability 

Real 

%  Time  Available  When 
Required 

Engine  AGE  Unreliability 

Real 

%  Time  Unreliable  When 

Used 

Engine  Vibration  Factors 

Real 

Convention: 

1  *  Low 

2  *  Medium 

3  -  High 
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6.2  COMPUTER-AIDED  DETECTION  AND  SCREENING  OF  PARAMETRIC 

HEUATI  O’NsH  TP'S - 


After  the  Master  Input  Data  File  was  transformed  into  suitable 
computer  input  records,  the  Boeing  Experience  Analysis  Center's  local 
cross-plotting  and  regression  analysis  program  "PKING"  was  applied  to 
the  data.  This  program  was  set  to  generate  cross-plots  and  regression 
statistics  for  the  following  candidate  variable  combinations: 

8  Maintenance  Resource  Demand  Parameters (Avionics  subsystems) 
8  Maintenance  Resource  Demand  Parameters  (Propulsion  system) 

6  Maintenance  Resource  Demand  Parameters  (Other  subsystems) 

18  Avionics  Equipment  Parameters  (Avionics  subsystem) 

15  Propulsion  Equipment  Parameters  (Propulsion  system) 

24  Other  Equipment  Parameters  (Other  subsystems) 

33  Operations  Parameters 
30  Environmental  Parameters 
29  Maintenance  Parameters 
15  General  Aircraft  Parameters 


A  set  of  cross-plots  and  regression  statistics  was  generated 
for  each  of  the  30  following  equipment  subsystem  types: 


_ Phase  I _ 

•  Propulsion  _ 

•  Flight  Indicators 

•  Air  Data  System 

•  Horizontal  Situation  Indicator 

•  Autopilot 

•  UHF  Communication  Set 

•  IFF  Transponder  Set 

•  Inertial  Navigation  Set 

•  Instrument  Landing  Set 
t  TACAN  Set 

e  Attitude  Heading  Ref.  Set 

•  Radar  Set 


Phase  II _ 

t  Radomes 

•  Windshields 

•  Wings 

•  Cockpit  Furnishings 
e  Landing  Gear 

t  Brakes 

•  Stabilator 
§  Ruader 

•  Flaps 

•  Environmental  Control  System 

•  Electrical  Power 
a  Navigation  Lights 

0  Landing/Taxi  Lights 
0  Hydraulic  Power 
0  Internal  Fuel 
0  Oxygen 
0  LOX 

0  Fire  Detection 
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The  data  cases  used  as  the  statistical  base  for  the  analysis 
of  these  equipments  was  gathered  for  the  following  aircraft/base 
combinations  during  the  course  of  Task  IV: 

•  F-15A/Luke  AFB,  Arizona 

•  F-15A/Bitburg  AB,  Germany 

•  B-526/Fairchild  AFB,  Washington 

•  FB-lllA/Plattsburgh  AFB,  New  York 

•  C-141A/Travis  AFB,  California 

•  KC-135A/Fairchild  AFB,  Washington 

•  T-38A/Randolph  AFB,  Texas 

•  A-IOA/Myrtle  Beach  AFB,  South  Carolina 

•  A-IOA/Davis-Monthan  AFB,  Arizona 

Using  this  nine  case  data  population  and  the  applicable 
candidate  variable  combinations,  against  each  of  the  30  subsystem 
equipment  types,  26,460  individual  scatterplots  were  generated. 

These  resulting  scatterplots  were  screened  for  significant 
causal  relationships  between  the  Maintenance  Resource  Demand  (MRD) 
parameters  and  the  Candidate  Maintenance  Impact  parameters.  The 
screening  criteria  utilized  were  as  follows: 

(1)  Correlation  Coefficient  of  Regression  0.5  or  greater. 

(2)  Visually  apparent  curvilinear  relationship. 

(3)  Acceptable  data  point  distribution. 

(4)  At  least  5  data  points,  4  of  which  were  non-zero  in 
both  the  ordinate  and  abscissa. 

Of  the  26,460  scattergrams  generated,  the  screening  process 
rejected  about  8990  as  being  insufficiently  correlated.  This  left 
11%  or  over  2900  correlated  relationships  from  which  to  formulate  a 
recommended  list  of  significant  Maintenance  Impact  Estimating  Relation¬ 
ships  (MIERs). 

As  stated  in  the  introduction,  the  same  variable  combination 
data  processing  and  screening  could  have  been  accomplished  with  any 
available  computer  program  possessing  cross-plotting  and  regression 
analysis  capability,  for  example,  SPSS  or  STATPK  (References^  and  <©>• 
Boeing  EAC's  "PKING"  program  was  used  to  gain  maximum  speed  and 
efficiency  in  processing  the  mass  of  data  contained  in  the  data  base. 

A  brief  description  of  this  program  follows: 


®  ''SPSS  Statistical  Package  for  the  Social  Sciences,"  Ibid. 

4$  BCS-1 0201 -01 9-R1  " MAINSTREAM- CTS  Interactive  Statistics 
Package  (STATPK),"  Ibid. 


6.2.1  DESCRIPTION  AND  USE  OF  "PKING" 

The  "PKING"  program  is  a  data  manipulation  program  written 
in  FORTRAN  IV,  which  can  handle  moderately  large  data  sets  (35  variables, 
100  data  points  per  variable)  such  as  are  encountered  in  cost  and 
support  system  analysis.  Program  input  is  flexible  and  straightforward 
in  the  form  of  data  tables.  Output  is  in  the  form  of  easy- to-read 
cross-plots  derived  from  the  input  variables. 

The  significant  characteristics  of  the  program  are  as  follows: 

•  The  Program  records  and  manipulates  data  for  from  2  to 
35  variables. 

•  As  many  as  100  entries  can  be  made  for  each  variable. 

•  All  35  variables  may  be  input  variables  or  — 

e  A  minimum  of  2  variables  may  be  input  variables. 

•  Up  to  33  of  the  output  variables  may  be  "transform 
variables"  created  by  transforms  within  the  program. 

•  Up  to  50  transform  algorithms  may  be  included  in  the 
program  to  manipulate  data  and  create  new  output 
variables  — 

•  A  total  of  35  output  variables  (input  variables  + 
transform  variables)  may  be  specified. 

•  The  transforms  may  be  any  “mathematical"  or  "logical" 
algorithms. 

•  A  simple  least  squares  regression  routine  is  computed 
for  each  variable  combination. 

9  The  output  of  the  program  consists  of  scattergrams  which 
plot  specific  combinations  of  input  and  transform 
variables. 

•  The  plots  may  be  constrained  somewhat  by  specifying  that 
certain  input  variables  only  be  used  as  "independent" 
variables. 

•  Otherwise  all  variables  are  treated  in  turn  as  independ¬ 
ent  variables  and  dependent  variables  against  all  other 
variables. 

•  The  form  of  the  output  scattergrams  has  been  carefully 
designed  to  permit  rapid  visual  scanning  for  two-variable 
correlations.  In  addition  the  appropriate  correlation 
coefficient  of  regression,  and  the  estimating  equation  slope 
and  intercept  are  annotated  to  each  scatterplot. 

•  Input  data  and  transform  data  is  stored  in  a  single  35-by- 
100  cell  addressable  matrix  to  facilitate  inter-program 
processing  and  easy  linking  with  other  data  manipulation 
programs  such  as  data  ranking  routines. 
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6.3  MAINTENANCE  IMPACT  ESTIMATING  RELATIONSHIP  (MIER)  DEVELOPMENT 

And'  Prioritization 


The  next  step  in  the  analysis  and  prioritization  of  the 
study  parameters  was  to  re-examine  the  apparently  correlated 
relationships  found  during  the  computer  processing  and  screening  process 
and  build  a  "MIER  Catalog"  of  potentially  useful  relationships.  The 
2900  odd  scattergrams  accepted  during  the  first  screening  were  re¬ 
examined  for  reasonable  data  distribution  and  statistical  usefulness. 
Several  hundred  scattergrams  which  had  passed  the  first  screening  were 
rejected  during  this  test  because  of  unacceptable  data  distribution. 

For  instance,  if  all  data  points  except  one  were  clustered  in  one  area 
of  the  plot,  the  regression  computation  often  yielded  a  correlation 
coefficient  greater  than  0.5  even  though  the  data  were  useless  for 
practical  purposes.  Other  scattergrams  were  rejected  on  the  basis  of 
not  enough  (4  or  more)  non-zero  data  points  to  have  any  statistical 
usefulness.  This  question  of  statistical  usefulness  can  be  illustrated 
by  referral  to  Figure  12.  Note  that  at  a  sample  size  of  5  (considered 
the  lower  useful  limit  for  this  study),  it  can  be  said  with  90% 
confidence  that  only  about  66%  of  the  possible  values  of  a  "total" 
continuous-valued  population  lie  within  the  distribution  of  values 
represented  by  the  available  sample.  Conversely,  we  can  only  be  about 
40%  confident  that  90%  of  the  possible  values  have  been  captured  by  a 
sample  of  5.  This  condition  improves  somewhat  at  the  "normal"  sample 
size  for  this  study  which  consists  of  9  data  points.  At  a  sample  of  9, 
we  can  estimate  with  90%  confidence  the  capture  of  nearly  80%  of  the 
possible  population  values,  or  estimate  with  60%  confidence  the 
capture  of  90%  of  the  possible  population  values.  The  nomograph  of 
Figure  12  thus  gives  a  measure  of  the  statistical  confidence  that  can 
be  placed  on  the  relationships  derived  from  the  data  base  of  this 
study. 

The  surviving  MIERs  from  this  second  screening  process  were 
then  sorted  first  by  equipment  item  and  then  by  MRD  type  within  equip¬ 
ment  items.  The  MIERs  within  each  MRD  type  within  each  equipment  item 
were  then  rank-ordered  by  correlation  coefficient  and  and  collated  in  a 
MIER  catalog  which  has  been  published  as  a  Supplement  1  to  Boeing 
Interim  Technical  Report  D1 94-1 0089-2  (Reference©).  Table  14  (sheets 
1  through  6)  contains  a  list  of"  study  parameters  which  were  found  to 
have  significant  impact  on  the  maintenance  resource  demands  of  the 
study  subsystems.  Table  15  (sheets  1  through  9)  indicates  the  specific 
parameters  which  impact  each  MRD  for  each  equipment  item.  The  Mainte¬ 
nance  Action  Demand  MIERs  were  used  to  develop  new  metrics  for  LCOM 
(Tasks  VI  and  VII)  while  those  in  the  other  maintenance  resource  demand 
categories  are  retained  for  future  study.  Figure  13  illustrates 
typical  examples  of  the  MIER  relationships  that  were  cataloged,  and 
Figure  14  shows  the  total  MIERs  detected  and  retailed. 
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HOMOGRAPH 


S/m£  SIZE  (N) 


FIGURE  12  NON  PARAMETRIC  TOLERANCE  LIMITS 
(SINGLE  TAIL  OR  ONE  SIDED  TEST) 
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Variable 

I.D. 

Numoer 


P02 

P03 

P04 

P05 

P13 

Fa5 

P17 

P18 

P19 

P20 

P23 


a  a 

A03 

A04 

A05 

A06 

A07 

A08 

A09 

A10 

All 

A12 

A13 

A14 

A15 

A16 

A18 

A19 

A21 

A22 

A23 

A26 

A27 


TABLE  14  SIGNIFICANT  MAINTENANCE  IMPACT  PARAMETERS 


Label  Name 


ENGINE  PARAMETERS 

Total  Number  of  Installed  Engines 

Take-Off  Thrust  per  Engine 

Weight  per  Engine 

Volume  per  Engine 

Engine  Prime  Depot 

Engine  Age  Unreliability 

Total  Maintenance  Manhours  per  Installed  Engine 
Total  Engine  Maintenance  Manhours  per  Aircraft 
Total  Engine  Removals  per  Aircraft 
Unscheduled  Engine  Removals  per  Aircraft 
Engine  Air  Aborts  per  Aircraft 


AVIONiCS  PARAMETERS 

Equipment  Location  on  Aircraft 
Equipment  Weight 
Equipment  uolume 
SRU  Cou  t 

Operating  Temperature 

reeling  Mr  thod 

Prote'_*  Devices 

Number  jf  Test  Points  (Org.  Level) 

Requ i r^d  Age 

Age  Availability 

Age  Unrel iabil i ty 

Average  Operating  Time  per  Sortie 

Failure/Malfunction  Causes 

Retest  OK  Rate 

On-Off  Cycles  per  Flying  Hour 
Ground/Flight  Operating  Ratio 
Failure/Abort  Ratio 

Equipment  Tctal  Maintenance  Manhour  per  Aircraft 
Equipment  Total  Removals  per  Aircraft 
Equipment  Unscheduled  Removals  per  Aircraft 
Equipment  Air  Aborts  per  Aircraft 
Equipment  Cannibil izations  per  Aircraft 


(SHEET  1) 
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TABLE  14  SIGNIFICANT  MAINTENANCE  IMPACT  PARAMETERS 


Variable 

I.D. 

Number 


F01 

F02 

F03 

F04 

F05 

F06 

F07 

F08 

F09 

FIO 

Fll 

F13 

F15 

F16 

F17 

F22 

F24 


R02 

R03 

R04 

R05 

R06 


Label  Name 


OTHER  EQUIPMENT  PARAMETERS 

Location  of  Equipment  on  the  Aircraft 

Primary  Material  -  Composition  Technology  Level 

Equipment  Weight 

Equipment  Volume 

Operating  Temperature 

Support  Equipment  Complexity 

Support  Equipment  Reliability 

Type  of  Failure  Problems 

Inflight  Squawk  Verification  Rate 

On/Off  Cycles  per  Sortie 

Ground  to  Flight  Operating  Ratio 

Removals  to  Access  Other  Equipment 

Principle  Failure  Cause 

Equipment  Protection  Methodology 

Equipment  Pressurization  Level 

Landings  per  Tire  (Tires) 

Securing  Method  Technology 


MAINTENANCE  RESOURCE  DEMAND  (MRD)  PARAMETERS 


Equipment  Total  Maintenance  Manhour  per  Aircraft 
Equipment  Total  Unscheduled  Removals  per  Aircraft 
Equipment  Ground  Aborts  per  Aircraft 
Equipment  Air  Aborts  per  Aircraft 
Equipment  Cannibil  izations  per  Aircraft 


(SHEET  2) 
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TABLE  14  SIGNIFICANT  MAINTENANCE  IMPACT  PARAMETERS 

OPERATIONAL  PARAMETERS 


Variable 

I.D. 

Number 

Label  Name 

002 

Years  Aircraft  Have  Been  on  Base 

003 

Average  Mission  Mix 

005 

Average  Take-Off  Speed 

006 

Median  Take-Off  Distance 

007 

Percent  of  Maximum  Take-Off  Weight 

008 

Average  Climb  Rate 

009 

Averaae  Cruise  Speed 

010 

Average  Cruise  Altitude 

Oil 

Average  Descent  Rate 

012 

Average  Landing  Speed 

013 

Minimum  Landing  Distance 

014 

Average  Landing  Weight 

015 

Total  Flying  Hours  per  Aircraft 

016 

Training  Flying  Hours  per  Aircraft 

017 

Operations  Flying  Hours  per  Aircraft 

018 

Misc.  Flying  Hours  per  Aircraft 

019 

Total  Landings  per  Aircraft 

020 

Training  Landings  per  Aircraft 

021 

Operations  Landings  per  Aircraft 

022 

Misc.  Landings  per  Aircraft 

023 

Average  Number  of  Aircraft  on  Alert 

024 

Average  Number  of  Deployed  Aircraft 

025 

Total  Sorties  per  Aircraft 

026 

Training  Sorties  per  Aircraft 

027 

Operations  Sorties  per  Aircraft 

028 

Misc.  Sorties  per  Aircraft 

029 

Average  Possessed  Aircraft 

030 

Maximum  Aircraft  Speed 

031 

Maximum  Aircraft  Ceiling 

032 

Aircraft  Crew  Size 

033 

Average  Sortie  Length 

034 

Accidents  (Major/Minor)  per  Aircraft 

035 

Incidents  per  Aircraft 

(SHEET  3) 
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TABLE  14  SIGNIFICANT  MAINTENANCE  IMPACT  PARAMETERS 
ENVIRONMENTAL  PARAMETERS 


Variable 

I.D. 

Number  Label  Name 


E02 

E03 

E04 

E05 

E06 

E07 

E08 

E09 

ElO 

Ell 

E12 

E13 

E14 

E15 

E16 

E17 

E18 

E19 

E20 

E21 

E22 

E23 

E24 

E25 

E26 

E27 

E28 


Base  Altitude 
Runway  Direction 
Distance  to  Mountains 
Direction  of  Mountains 
Number  of  Snow  Days 
Total  Snow  Fall 
Mean  Snow  Depth 
Number  of  Rain  Days 
Total  Rain  Fall 
Number  of  Hail  Days 
Relative  Humidity  (Averaqe) 

Number  of  Thunder  Days 

Number  of  Sleet  Days 

Number  of  Fog  Days 

Predominate  Wind  Direction 

Maximum  Cross wind's  Less  Than  10  MPH 

Maximum  Crosswind's  10-19  MPH 

Maximum  Crosswind's  20-29  MPH 

Maximum  Crosswind's  30-39  MPH 

Maximum  Crosswind's  40-49  MPH 

Maximum  Crosswind's  Greater  Than  50  MPH 

Mean  Temperature 

Mean  Minimum  Temperature 

Mean  Maximum  Temperature 

Days  Maximum  Temperature  was  Above  80°  "F 

Days  Minimum  Temperature  was  Below  32°  "F 

Total  Number  of  Obstructions  to  Vision 


E30  Average  Obstruction  Type 

E31  Average  Obstruction  Severity 


(SHEET  4) 
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TABLE  14  SIGNIFICANT  MAINTENANCE  IMPACT  PARAMETERS 
MAINTENANCE  PARAMETERS 


Variable 

I.D. 

Number 


Label  Name 


Average  OR  Rate 
Average  NORM  Rate 
Average  NORS  Rate 

Total  Maintenance  Personnel  Authorized 

Total  Maintenance  Personnel  Assigned 

Total  3  Level  Maintenance  Personnel  Assigned 
Total  5  Level  Maintenance  Personnel  Assigned 
Total  7  Level  Maintenance  Personnel  Assigned 
Total  9  Level  Maintenance  Personnel  Assigned 
Total  Maintenance  Personnel  Authorized  (AMS) 

Total  Maintenance  Personnel  Assigned  (AMS) 

Total  3  Level  Maintenance  Personnel  Assigned  (AMS) 

Total  5  Level  Maintenance  Personnel  Assigned  (AMS) 

Total  7  Level  Maintenance  Personnel  Assigned  (AMS) 

Total  9  Level  Maintenance  Personnel  Assigned  (AMS) 

Total  Maintenance  Manhours  Expended  per  Aircraft 
AMS  Maintenance  Manhours  Expended  per  Aircraft 

Average  Turn-Around  Time  -  Maintenance 
Aircraft  FOD  (All  Causes)  , 

Total  General  Support  (01-09)  Manhours  per  Aircraft 
Total  General  Support  -  01  Manhours  per  Aircraft 
Ground  Handling  and  Servicing  . 

Total  General  Support  -  02  Manhours  per  Aircraft 
Aircraft  Cleaning 

Total  General  Support  -  03  Manhours  per  Aircraft 
Look  Phase  of  Scheduled  Inspections 
Total  General  Support  -  04  Manhours  per  Aircraft 
Special  Inspections 

Total  General  Support  -  05  Manhours  per  Aircraft 
Preservation  and  Storage 

Total  General  Support  -  06  Manhours  per  Aircraft 
Arming  and  Disarming 

Total  General  Support  -  07  Manhours  per  Aircraft 
Preparation  and  Maintenance  of  Records 
Total  General  Support  -  09  Manours  per  Aircraft 
In-Shop  General  Support 

(SHEET  5) 
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TABLE  14  SIGNIFICANT  MAINTENANCE  IMPACT  PARAMETERS 
AIRCRAFT  GENERAL  PARAMETERS 


Variable 

I.D. 

Number  Label  Name 


G02 

G03 

G04 

G05 

G06 

G07 

G08 

G09 

G10 

Gil 

G12 

G13 

G14 

G15 

G16 


Years  Since  Aircraft  was  Produced 

Aircraft  Empty  Weight 

Maximum  Gross  Weight  -  Take-Off 

Aircraft  Wing  Area 

Aircraft  Aspect  Ratio 

Total  Fuel  Capacity 

Average  Aircraft  Wing  Load 

Years  Since  Engine  Production 

Number  of  Installed  Engines  per  Aircraft 

Engine  Weight  per  Aircraft  (All  Engines) 

Total  Thrust  per  Aircraft 

Designated  Climb  Rate 

Number  of  Generator's  per  Aircraft 

Total  Maintenance  Manhour  per  Flight  Hour 

Years  Since  Aircraft  First  Flight 


(SHEET  6) 
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SIGNIFICANT  MAINTENANCE  IMPACT  RELATIONSHIPS  DETECTED 


rqmmNT  CAHNIBAUMTIOW _ |  A02.A03.A04  JUS,A19,»24  J30tH02.H06,H07.Hn.H12.H13.MM,H29.G06.G08 


TABLE  15  SIGNIFICANT  MAINTENANCE  IMPACT  RELATIONSHIPS  DETECTEO 


SIGNIFICANT  MAINTENANCE  IMPACT  RELATIONSHIPS  DETECTED 


TABLE  15  SIGNIFICANT  MAINTENANCE  IMPACT  RELATIONSHIPS  DETECTED 


TABLE  15  SIGNIFICANT  MAINTENANCE  IMPACT  RELATIONSHIPS  DETECTED 


TABLE  15  SIGNIFICANT  MAINTENANCE  IMPACT  RELATIONSHIPS  DETECTED 


«Y  TO  IMPACTING  PARAMETER  MIHUERS  GIVEN  IN  TABLE  14 


TABLE  15  SIGNIFICANT  MAINTENANCE  IMPACT  RELATIONSHIPS  DETECTED 


I 


t 
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TO  MTACTING  PANAHIIIA  NtPHlim  GIVIM  IN  TABU  14  SHUT 


FIGURE  13  TYPICAL  MIER'S  (TACAH  SET) 


AIRCRAFT 

GENERAL 


FIGURE  14  NUMBER  OF  MIER'S  DETECTED  AND  RETAINED 


7,0  DEVELOPMENT  OF  MAINTENANCE  METRICS  AND  WEIGHTINGS 
MODELS  -  TASKS  VI  AND  VII 


Tasks  VI  and  VII  were  the  development  of  new  comprehensive 
prediction  and  estimation  models  for  maintenance  action  rates  from  the 
field  experience  and  analytical  data  base  accumulated  by  the  first  five 
study  tasks.  The  objective  of  this  model  development  effort  is  the 
improvement  of  the  estimation  techniques  currently  used  to  predict  the 
maintenance  metrics  of  emerging  weapon  systems  and/or  new  basing 
concepts.  Task  VI  was  originally  intended  to  be  an  effort  which 
utilized  the  design,  packaging  environment,  and  use  characteristics  of 
the  equipment  items  studied  to  develop  statistical  mathematic -or 
parametric  models  for  the  estimation  of  the  resource  demands  of  each 
study  subsystem.  Task  VII  was  intended  to  develop  statistical  weighting 
factors  with  which  to  appropriately  modify  model  estimation  results  to 
compensate  for  specific  aircraft  basing  concepts  operational  and 
environmental  conditions. 

Study  Task  VI/VI I  contained  two  distinct  subefforts.  The 
first  was  to  develop  the  necessary  maintenance  metrics  to  predict  sub¬ 
system  maintenance  action  demand.  The  second  effort  was  the  develop¬ 
ment  of  means  for  estimating  lower  level  task  selection  probabilities 
within  a  particular  maintenance  action.  That  is,  estimation  of  the 
probability  of  whether  the  maintenance  action  will  take  place  "on 
equipment"  or  "off  equipment,"  and  the  respective  probabilities  of  the 
various  alternatives  within  these  two  categories.  Figure  15  depicts 
the  general  analytical  approach  divided  into  the  related  subtasks  which 
were  necessary  to  accomplish  the  above  two  subefforts.  Complete  details 
and  data  pertaining  to  Task  VI/VI I  study  efforts  are  contained  in 
Boeing  Interim  Technical  Report  D194-10089-3  (Reference/^  and  are 
summarized  in  the  remainder  of  Section  7. 

The  approach  taken  for  the  first  portion  of  the  Task  VI/VI  I 
study  effort  (subtasks  6&7.1  -  6&7.7)  was  to  utilize  the  source  data 
assembled  during  Task  IV  (Section  5.0)  for  the  significant  correlates 
identified  in  Task  V  (Section  6.0).  as  inputs  to  develop  statistical 
models  for  the  estimation  and  prediction  of  the  maintenance  action 
demands  of  the  equipment  items  selected  for  study.  The  data-case 
values  acquired  for  the  lists  of  equipment,  operational,  and  environ¬ 
mental  parameters  which  were  found  in  Task  V  (Analyzing  and  Prioritizing 
Parameters)  to  be  directly  and  strongly  related  to  the  maintenance 
demand  rates  of  the  selected  equipment  items  were  reconstituted  into 
input  data  sets  for  the  modeling  process  (6&7.1  and  6&7.2).  This 
process  resulted  in  one  equipment,  one  operational,  and  one  environ¬ 
mental  data  set  being  associated  with  each  aircraft  subsystem  studied. 
Step-wise  regression  analysis  was  then  applied  to  each  data  set  for 
each  subsystem's  equipment  to  obtain  "best  fit"  multiple  regression 
equations  explaining  maintenance  action  demand  as  a  function  of 
equipment  characteristic  parameters,  as  a  function  of  operational 
characteristic  parameters,  and  as  a  function  of  environmental 
characteristic  parameters  ( 6&7 . 3 ) .  These  separate  equations  for  each 
type  of  parameter  constitute  "generic"  Maintenance  Metrics  and 
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Weightings  Models  which  facilitate  the  estimation  of  expected  main¬ 
tenance  action  demand  for  any  aircraft  subsystem  when  only  equipment 
characteristics,  only  operational  characteristics ,  or  only  environ¬ 
mental  characteristics  are  known.  The  preparation,  execttion,  and 
results  of  the  above  three  subtasks  are  discussed  in  Subsection  7.1. 
Summary  documentation  of  these  models  (6&7.7)  is  contained  in 
Appendix  0. 


Next,  "composite"  Maintenance  Metrics  and  Weightings  Models 
were  developed  from  the  generic  models  for  each  aircraft  subsystem. 

The  following  approach  was  utilized.  The  component  parameters  in  the 
respective  generic  equipment,  operational,  and  environmental  regression 
equations  for  each  subsystem  were  reconstituted  into  a  composite  data 
set  corresponding  to  each  subsystem  (6&7.4).  Step-wise  regression  was 
applied  to  these  composite  data  sets  (6&7.5).  This  process  resulted 
in  a  "best  fit"  estimating  equation  to  explain  the  expected  maintenance 
action  demand  of  each  aircraft  subsystem  in  terms  of  the  equipment, 
operational,  and  environmental  parameters  selected  from  the  corresponding 
composite  data  set  by  the  step-wise  regression  process.  These  composite 
models  provide  a  more  accurate  statistical  estimation  of  the  maintenance 
demand  for  a  given  subsystem  than  any  of  the  three  types  of  generic 
models  used  singly.  The  composite  models  should  therefore  be  used  to 
predict  maintenance  action  rates  whenever  the  appropriate  equipment, 
operational,  and  environmental  data  can  be  obtained.  The  accomplish¬ 
ment  and  results  of  the  composite  model  development  effort  are  discussed 
in  Subsection  7.2.  Documentation  of  these  models  (6&7.7)  is  contained 
in  Appendix  E. 

The  maintenance  action  demand  estimating  models  developed 
through  the  above  efforts  are  useful  for  the  prediction  of  the  various 
study  subsystems'  maintenance  action  rates  under  new  equipment  design 
conditions,  new  environmental  conditions,  and/or  new  operational 
scenarios.  One  intended  use  of  the  products  of  Task  VI/VI  I  is  the 
improvement  of  input  values  for  LOOM  maintenance  network  failure  clock 
when  simulating  new  systems  and  situations.  To  this  end,  a  routine 
was  developed  for  the  calculation  of  these  expected  LCOM  F-clock  values 
from  the  outputs  of  the  maintenance  action  demand  estimating  models 
discussed  above.  This  effort  is  depicted  in  Subsection  7.3.  Appendix  F 
contains  a  completed  example  of  the  F-clock  calculation  routine. 

The  last  subtask  (6S7.8)  for  the  metrics  and  weightings 
development  effort  was  the  development  of  an  estimation  procedure  for 
LCOM  maintenance  network  task  selection  probabilities.  The  approach 
taken  for  this  task  was  a  straightforward  averaging  method  using 
historic  task  frequency  data.  Specific  maintenance  task  frequencies 
were  extracted  from  the  study  data  base  for  each  data  case  (aircraft/ 
base  combination)  for  each  aircraft  subsystem.  The  mean,  median,  and 
range  of  the  frequency  of  performance  for  each  task  for  each  subsystem 
was  then  computed.  The  results  of  this  analysis  facilitate  the 
estimation  of  the  LCOM  maintenance  network  task  selection  probabilities 
for  the  simulation  of  new  weapon  systems  and  basing  concepts.  The  sub¬ 
task  6&7 .8  effort  and  results  are  summarized  in  Subsection  7.4. 
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7.1  DEVELOPMENT  OF  GENERIC  MAINTENANCE  ACTION  DEMAND  ESTIMATING 

MODELS  -  SUBTASKS  6  &  7.1,  6  &  7,2,  and  6  &  7.3 

The  first  step  in  the  process  of  development  of  comprehensive 
Maintenance  Metrics  and  Weightings  Models  for  aircraft  systems  was  to 
explore  the  feasibility  of  generic  estimation  models  whereby  the  main¬ 
tenance  action  demand  for  a  given  subsystem  could  be  predicted  from  just 
equipment  characteristics,  just  operational  characteristics,  or  just 
environmental  characteristics .  To  this  end,  generic  model  development 
data  sets  were  assembled.  These  data  sets  were  extracted  from  the  data 
base  acquired  through  the  processes  of  the  first  four  study  tasks,  and 
are  composed  of  the  equipment,  operational,  and  environmental  parameters 
which  were  found  to  be  significantly  correlated  with  maintenance  action 
demand  during  the  course  of  Task  V.  Three  generic  significant-parameter 
data  sets  were  assembled  for  each  of  the  thirty  aircraft  subsystem 
equipments  investigated. 

Step-wise  regression  analysis  was  then  applied  to  each  of 
the  significant-parameter  data  sets  to  find  the  "best  fit"  multiple 
regression  equation  to  explain  maintenance  action  demand  in  terms  of  some 
or  all  of  the  parameters  included  in  each  of  the  three  data  sets 
corresponding  to  each  of  the  thirty  aircraft  subsystems  analyzed.  This 
effort  resulted  in  the  derivation  of  ninety  regression  equations  for 
the  estimation  of  — 

•  MAD  as  a  function  of  Equipment  Characteristic  Parameters, 

•  MAD  as  a  function  of  Operational  Characteristic  Parameters, 

t  MAD  as  a  function  of  Environmental  Characteristic  Parameters, 

the  ninety  equations  comprised  one  set  of  three  equations  for  each  of 
the  thirty  subsystems.  An  interactive  computer  technique  was  utilized 
to  develop  the  above  referenced  equations.  The  program  package  used 
was  Boeing  Computer  Services  "Conversational  Terminal  System"  statistical 
program  package  (STAT  PACK),  stepwise  regression  subroutine  (Reference 
UBjl).  This  program  allows  the  analyst  to  experiment  freely  with  the 
choice  of  independent  variables  to  be  included  in  the  regression 
equation  and  thus  find  an  optimum  fit  of  the  data  in  terms  of  multiple 
correlation  coefficient,  standard  error  of  the  estimate,  and  the 
T-statistics  of  the  included  variables.  The  general  procedure  used  in 
the  development  of  the  three  categories  of  generic  models  as  well  as 
the  composite  models  discussed  in  following  Subsection  7.2  is  depicted 
by  Figure  16.  Table  16  lists  the  equipment  characteristic  parameters 
which  enter  each  subsystem  model  in  the  "Equipment"  generic  model 
category.  Tables  17  and  18  list  the  operational  characteristic 
parameters  and  environmental  characteristic  parameters  entering  each 


"Mainstream  -  CTS  Interactive  Statistical  Package  (STATPK)," 
Boeing  Computer  Services,  Seattle,  Washington,  March  1978. 
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FIGURE  16  TASKS  VI  AND  VII  PROCESS  FLOW 


TABLE  16  SUBSYSTEM  MAO  AS  A  FUNCTION  OF  EQUIPMENT  PARAMETERS  ONLY 
_  (Sheet  1) 


SUBSYSTEM 

EQUIPMENT  PARAMETERS 

ENTERING  MAD  ESTIMATING  EQUATION 

Propulsion 

P02  -  Total  Number  of  Installed  Engines 

P04  -  Weight  per  Engine 

Flight  Indicators 

A03  -  Equipment  Weight 

Air  Data  System 

A 03  -  Equipment  Weight 

A07  -  Cooling  Method 

AT 6  -  On-Off  Cycles  per  Flying  Hour 

A19  -  Failure  Abort  Ratio 

Horizontal  Situation 
Indicator 

A07  -  Cooling  Method 

A16  -  On-Off  Cycles  per  Flying  Hour 

A18  -  Ground/ FI ight  Operating  Ratio 

Autopilot 

A03  -  Equipment  Weight 

A04  -  Equipment  Volume 

A08  -  Protection  Devices 

A13  -  Average  Operating  Time  per  Sortie 

A19  -  Failure/ Abort  Ratio 

UHF  Communications  Set' 

A03  -  Equipment  Weight 

A04  -  Equipment  Volume 

AOS  -  SR U  Count 

IFF  Transponder  Set 

A02  -  Equipment  Location  on  Aircraft 

A09  -  Number  of  Test  Points 

Inertial  Navigation 

Set 

A05  -  SRU  Count 

Instrument  Landing  Set 

A02  -  Equipment  Location  on  Aircraft 

A06  -  Operating  Temperature 

AT  5 —  Retest  OK  Rate 

TACAN  Set 

A03  -  Equipment  Weight 

A18  -  Ground/Flight  Operating  Ratio 

Attitude-Heading 
Reference  Set 

A08  -  Protection  Devices 

A12  -  AGE  Unreliability 

NOTE:  SEE  APPENDIX  0  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS. 


TABLE  16  SUBSYSTEM  MAD  AS  A  FUNCTION  OF  EQUIPMENT  PARAMETERS  ONLY 
_ _ (Sheet  2) 


SUBSYSTEM 

EQUIPMENT  PARAMETERS 

ENTERING  MAD  ESTIMATING  EQUATION 

Radar  Set 

A02  -  Equipment  Location  on  Aircraft 

A12  -  AGE  Unreliability 

A19  -  Failure/Abort  Ratio 

Radome 

F08  -  Type  of  Failure 

Windshield 

F03  -  Equipment  Weight 

F07  -  Support  Equipment  Reliability 

" 

Wings 

F04  -  Equipment  Volume 

Cockpit  Furnishings 

FI  1  -  Ground/Flight  Operating  Ratio 

Main  Landing  Gear 

F03  -  Equipment  Weight 

F06  -  Support  Equipment  Complexity 

FI 3  -  Removals  to  Access  Other  Equipment 

F22  -  Landings  per  Tire  Allowed 

Brakes 

F09  -  Flight  Brake  Squawk  Verification  Rate 

Stabilator 

F03  -  Weight 

F06  -  Support  Equipment  Complexity 

Rudder 

None  (No  Correlated  Data) 

Flaps 

F03  -  Equipment  Weight 

F04  -  Equipment  Volume 

F06  -  Support  Equipment  Complexity 

FQ8  -  Type  of  Failure  Predominant 

FI 0  -  On-Off  Cycles  per  Sortie 

Environmental  Control 
System 

F08  -  Predominant  Type  of  Failure 

Electrical  Power 
Generation 

FI 3  -  Removals  to  Access  Other  Equipment 

Anti-Collision  Lights 

F03  -  Equipment  Weight 

F06  -  Support  Equipment  Complex 

Landing/Taxi  Lights 

F03  -  Equipment  Weight 

FI 3  -  Removals  to  Access  Other  Equipment 

NOTE:  SEE  APPENDIX  D  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS. 
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TABLE  16  SUBSYSTEM  MAD  AS  A  FUNCTION  OF  EQUIPMENT  PARAMETERS  ONLY 
_ _ _ (Sheet  3) 


SUBSYSTEM 

EQUIPMENT  PARAMETERS 

ENTERING  MAD  ESTIMATING  EQUATION 

Hydraulic  Power  System 

F04  -  Equipment  Volume 

Fll  -  Ground/Flight  Operating  Ratio 

Internal  Fuel  System 

FI 6  -  Equipment  Protection  Methodology 

Oxygen  Regulator 

F03  -  Equipment  Weight 

LOX  Converter 

F08  -  Predominant  Type  of  Failure 

Engine  Fire 

Detection 

F04  -  Equipment  Volume 

F08  -  Predominant  Type  of  Failure 

NOTE:  SEE  APPENDIX  D  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS. 
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TABLE  17  SUBSYSTEM  MAD  AS  A  FUNCTION  OF  OPERATIONAL  PARAMETERS  ONLY 
_ _ (Sheet  1) _ _ 


SUBSYSTEM 

OPERATIONAL  PARAMETERS 

ENTERING  MAD  ESTIMATION  EQUATION 

Propulsion  System 

010  -  Average  Cruise  Altitude 

014  -  Average  Landing  Weight 

027  -  Operations  Sorties  per  Aircraft 

032  -  Aircraft  Crew  Size 

033  -  Average  Sortie  Length 

Flight  Indicators 

011  -  Average  Descent  Rate 

013  -  Minimum  Landing  Distance 

017  -  Operations  Flying  Hours  per  Aircraft 

025  -  Total  Sorties  per  Aircraft 

Air  Data  System 

008  -  Average  Climb  Rate 

013  -  Minimum  Landing  Distance 

023  -  Average  Number  of  Alert  Aircraft 

Horizontal  Situation 
Indicator 

(314  -  Average  Landing  Weight 
(333  -  Average  Sortie  Length 

Autopilot 

008  -  Average  Climb  Rate 

023  -  Average  Number  of  Alert  Aircraft 

UHF  Communication  Set 

008  -  Average  Climb  Rate 

018  -  Miscellaneous  Flying  Hours  per  Aircraft 

IFF  Transponder  Set 

005  -  Average  Take-Off  Speed 

009  -  Average  Cruise  Speed 

012  -  Average  Landing  Speed 

030  -  Maximum  Aircraft  Speed 

Inertial  Navigation  Set 

013  -  Minimum  Landing  Distance 

Instrument  Landing  Set 

015  -  Total  Flying  Hours  per  Aircraft 

027  -  Operations  Sorties  per  Aircraft 

032  -  Aircraft  Crew  Size 

TACAN  Set 

015  -  Total  Flying  Hours  per  Aircraft 

032  -  Aircraft  Crew  Size 

Attitude-Heading 
Reference  Set 

005  -  Average  Take-Off  Speed 

NOTE:  SEE  APPENDIX  D  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS 
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TABLE  17  SUBSYSTEM  MAD  AS  A  FUNCTION  OF  OPERATIONAL  PARAMETERS  ONLY 

(Sheet  2)  _ 


SUBSYSTEM 

OPERATIONAL  PARAMETERS 

ENTERING  MAD  ESTIMATION  EQUATION 

Radar  Set 

010  -  Average  Cruise  Altitude 

011  -  Average  Descent  Rate 

Radome 

005  -  Average  Take-Off  Speed 

012  -  Average  Landing  Speed 

021  -  Operations  Landings  per  Aircraft 

025  -  Total  Sorties  per  Aircraft 

Windshields 

015  -  Total  Flying  Hours  per  Aircraft 

021  -  Operations  Landings  per  Aircraft 

027  -  Operations  Sorties  per  Aircraft 

Wings 

002  -  Years  Aircraft  Have  Been  On  Base 

008  -  Average  Climb  Rate 

010  -  Average  Cruise  Altitude 

012  -  Average  Landing  Speed 

014  -  Average  Landing  Weight 

017  -  Operations  Flying  Hours  per  Aircraft 

021  -  Operations  Landings  per  Aircraft 

Cockpit  Furnishings 

008  -  Average  Climb  Rate 

012  -  Average  Landing  Speed 

017  -  Operations  Flying  Hours  per  Aircraft 

021  -  Operations  Landings  per  Aircraft 

025  -  Total  Sorties  per  Aircraft 

027  -  Operations  Sorties  per  Aircraft 

Main  Landing  Gear 

.. 

010  -  Average  Cruise  Altitude 

014  -  Average  Landing  Weight 

015  -  Total  Flying  Hours  per  Aircraft 

016  -  Training  Flying  Hours  per  Aircraft 

019  -  Total  Landings  per  Aircraft 

021  -  Operations  Landings  per  Aircraft 

032  -  Aircraft  Crew  Size 

_  ikes 

003  -  Average  Mission  Mix 

005  -  Average  Take-Off  Speed 

009  -  Average  Cruise  Speed 

016  -  Training  Flying  Hours  per  Aircraft 

020  -  Training  Landings  per  Aircraft 

026  -  Training  Sorties  per  Aircraft 

031  -  Aircraft  Service  Ceiling 

NOTE:  SEE  APPENDIX  D  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS. 
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TABLE  17  SUBSYSTEM  MAD  AS  A  FUNCTION  OF  OPERATIONAL  PARAMETERS  ONLY 


SUBSYSTEM 

OPERATIONAL  PARAMETERS 

ENTERING  MAD  ESTIMATION  EQUATION 

Stabilator 

015  -  Total  Flying  Hours  per  Aircraft 

027  -  Operations  Sorties  per  Aircraft 

Rudder 

015  -  Total  Flying  Hours  per  Aircraft 

017  -  Operations  Flying  Hours  per  Aircraft 

034  -  Accidents  (Major/Minor)  per  Aircraft 

Flaps 

015  -  Total  Flying  Hours  per  Aircraft 

021  -  Operations  Landings  per  Aircraft 

027  -  Operations  Sorties  per  Aircraft 

Environmental  Control 
System 

None  (No  Correlated  Data) 

Electrical  Power 
Generation 

007  -  Average  Take-Off  Weight(%  Max. Take-Off 
Weight) 

032  -  Aircraft  Crew  Size 

Anti -Coll  is  ion  Lights 

011  -  Average  Descent  Rate 

021  -  Operations  Landings  per  Aircraft 

025  -  Total  Sorties  per  Aircraft 

027  -  Operations  Sorties  per  Aircraft 

Landing/Taxi  Lights 

015  -  Total  Flying  Hours  per  Aircraft 

021  -  Operations  Landings  per  Aircraft 

027  -  Operations  Sorties  per  Aircraft 

Hydraulic  Power 

System 

005  -  Average  Take-Off  Speed 

006  -  Median  Take-Off  Distance 

008  -  Average  Climb  Rate 

014  -  Average  Landing  Weight 

032  -  Aircraft  Crew  Size 

033  -  Average  Sortie  Length 

Internal  Fuel  System 

010  -  Average  Cruise  Altitude 

011  -  Average  Descent  Rate 

015  -  Total  Flying  Hours  per  Aircraft 

017  -  Operations  Flying  Hours  per  Aircraft 

021  -  Operations  Landings  per  Aircraft 

027  -  Operations  Sorties  per  Aircraft 

NOTE:  SEE  APPENDIX  D  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS. 
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TABLE  17  SUBSYSTEM  MAD  AS  A  FUNCTION  OF  OPERATIONAL  PARAMETERS  ONLY 
_ (Sheet  4) _ 


SUBSYSTEM 

OPERATIONAL  PARAMETERS 

ENTERING  MAD  ESTIMATION  EQUATION 

Oxygen  Regulator 

030  -  Maximum  Aircraft  Speed 

LOX  Converter 

005  -  Average  Take-Off  Speed 

006  -  Median  Take-Off  Distance 

033  -  Average  Sortie  Length 

Engine  Fire  Detection 

None  (No  Correlated  Data) 

NOTE:  SEE  APPENDIX  D  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS. 
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TABLE  18  SUBSYSTEM  MAD  AS  A  FUNCTION  OF  ENVIRONMENTAL  PARAMETERS  ONLY 

(Sheet  1 ) _ 


SUBSYSTEM 


ENVIRONMENTAL  PARAMETERS 
ENTERING  MAD  ESTIMATION  EQUATION 


Propulsion  System 


Flight  Indicators 


Air  Data  System 


Horizontal  Situation 
Indicator 


Autopilot 


UHF  Communication  Set 


IFF  Transponder  Set 


Number  of  Thunder  Days  per  Year 


Runway  Direction 

Days  per  Year  Max.  Crosswinds  20-29  MPH 


Number  of  Thunder  Days  per  Year 
Days  per  Year  Max.  Crosswinds  20-29  MPH 
Days  per  Year  Max.  Crosswinds  30-39  MPH 


Number  of  Thunder  Days  per  Year 

Days  per  Year  Max.  Crosswinds  1C-19  MPH 

Days  per  Year  Max.  Crosswinds  30-39  MPH 


Mean  Snow  Depth 

Days  per  Year  Max.  Crosswinds  10-19  MPH 


Number  of  Thunder  Days  per  Year 
Days  per  Year  Max.  Crosswinds  10-19  MPH 
Days  per  Year  Max.  Crosswinds  20-29  MPH 
Days  per  Year  Min.  Temp.  Below  32°  F 
Predominant  Type  of  Vision  Obstruction 


Number  of  Snow  Days  per  Year 
Number  of  Rain  Days  per  Year 
Average  Severity  of  Vision  Obstruction 


Inertial  Navigation  Set  E21  -  Days  per  Year  Max.  Crosswinds  40-49  MPH 


Instrument  Landing  Set  I  E20  -  Days  per  Year  Max.  Crosswinds  30-39  MPH 


TACAN  Set 


Attitude-Heading 
Reference  Set 


Radar  Set 


-  Runway  Direction 

-  Number  of  Rain  Days  per  Year 

-  Number  of  Thunder  Days  per  Year 

-  Days  per  Year  Max.  Crosswinds  30-39  MPH 


-  Days  per  Year  Min.  Temp.  Below  32°  F 


Number  of  Thunder  Days  per  Year 
Predominant  Wind  Direction 
Days  per  Year  Max.  Crosswinds  10-19  MPH 
Days  per  Year  Max.  Crosswinds  30-39  MPH 


NOTE:  SEE  APPENDIX  D  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS. 
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TABLE  18  SUBSYSTEM  MAO  AS  A  FUNCTION  OF  ENVIRONMENTAL  PARAMETERS  ONLY 
_ (Sheet  2) _ 


SUBSYSTEM 

ENVIRONMENTAL  PARAMETERS 

ENTERING  MAD  ESTIMATION  EQUATION 

Radome 

E02  -  Base  Altitude 

El 8  -  Days  per  Year  Max.  Crosswinds  10-19  MPH 
E20  -  Days  per  Year  Max.  Crosswinds  30-39  MPH 

Windshield 

E18  -  Days  per  Year  Max.  Crosswinds  10-19  MPH 

Wings 

El 3  -  Number  of  Thunder  Days  per  Year 

E20  -  Days  per  Year  Max.  Crosswinds  30-39  MPH 

Cockpit  Furnishings 

E20  -  Days  per  Year  Max.  Crosswinds  30-39  MPH 

Main  Landing  Gear 

E20  -  Days  per  Year  Max.  Crosswinds  30-39  MPH 

Brakes 

E03  -  Runway  Direction 

El 6  -  Predominant  Wind  Direction 

Stabilator 

E20  -  Days  per  Year  Max.  Crosswinds  30-39  MPH 

Rudder 

E03  -  Runway  Direction 

E09  -  Number  of  Rain  Days  per  Year 

El 8  -  Days  per  Year  Max.  Crosswinds  10-19  MPH 
E24  -  Mean  Minimum  Temperature 

Flaps 

El 8  -  Days  per  Year  Max.  Crosswinds  10-19  MPH 

El 9  -  Days  per  Year  Max.  Crosswinds  20-29  MPH 

Environmental  Control 
System 

El 9  -  Days  per  Year  Max.  Crosswinds  20-29  MPH 
E24  -  Mean  Minimum  Temperature 

Electric  Power 
Generation 

El  3  -  Number  of  Thunder  Days  per  Year 

Anti -Colli sion  Lights 

E02  -  Base  Altitude 

E03  -  Runway  Direction 

El 8  -  Days  per  Year  Max.  Crosswinds  10-19  MPH 
E30  -  Average  Vision  Obstruction  Type 

Landing/Taxi  Lights 

El 8  -  Days  per  Year  Max.  Crosswinds  10-19  MPH 

El 9  -  Days  per  Year  Max.  Crosswinds  20-29  MPH 

Hydraulic  Power  System 

E06  -  Number  of  Snow  Days  per  Year 

E08  -  Mean  Snow  Depth 

NOTE:  SEE  APPENDIX  D  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS. 
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TABLE  18  SUBSYSTEM  MAD  AS  A  FUNCTION  OF  ENVIRONMENTAL  PARAMETERS  ONLY 
_ _  (Sheet  3) 


SUBSYSTEM 

ENVIRONMENTAL  PARAMETERS 

ENTERING  MAD  ESTIMATION  EQUATION 

Internal  Fuel  System 

El 6  -  Predominant  Wind  Direction 

El 8  -  Days  per  Year  Max.  Crosswinds  10-19  MPH 

El 9  -  Days  per  Year  Max.  Crosswinds  20-29  MPH 
E23  -  Mean  Temperature 

Oxygen  Regulator 

E06  -  Number  of  Snow  Days  per  Year 

E07  -  Total  Snow  Fall 

El 6  -  Predominant  Wind  Direction 

E21  -  Days  per  Year  Max.  Crosswinds  40-49  MPH 
E23  -  Mean  Temperature 

E24  -  Mean  Minimum  Temperature 

E27  -  Days  per  Year  Minimum  Temp.  Below  32°  F 

LOX  Converter 

E08  -  Mean  Snow  Depth 

Engine  Fire  Detection  El 6  -  Predominant  Wind  Direction 

El 9  -  Days  per  Year  Max.  Crosswinds  20-29  MPH 
E24  -  Mean  Minimum  Temperature 


NOTE:  SEE  APPENDIX  D  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS. 
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subsystem's  generic  model  in  those  respective  categories.  Summary 
listings  of  the  thirty  complete  model  equations  in  each  generic  category 
are  included  in  Appendix  0  of  this  report.  Complete  details  and  listings 
of  the  generic  models  may  be  found  in  Boeing  Interim  Technical  Report 
D194-10089-3  (Referencen^) . 

7.2  DEVELOPMENT  OF  COMPOSITE  MAINTENANCE  ACTION  DEMAND 

ESTIMATING  MODELS  -  SUBTASKS  6  &  7.4  and  6  &  7.5 


The  next  step  in  the  development  of  comprehensive  Maintenance 
Metrics  and  Weightings  Models  for  aircraft  was  the  derivation  of  MAD 
estimating  models  which  combine  the  maintenance  impacts  of  equipment, 
operational,  and  environmental  characteristics  in  a  single  model  for 
each  subsystem  studied  (refer  to  Figure  16).  To  this  end,  composite 
model  development  data  sets  were  assembled  for  each  aircraft  subsystem. 

The  equipment,  operational,  and  environmental  parameters  selected  for 
inclusion  in  each  data  set  were  those  parameters  which  were  included 
in  the  generic  models  for  each  subsystem. 

The  STAT  PACK  Stepwise  Regression  routine  was  then  applied 
to  each  of  these  composite  data  sets  to  find  the  "best  fit"  MAD  estimating 
multiple  regression  model  from  among  the  candidate  independent  variables 
(equipment,  operational,  and  environmental  parameters)  included  in  the 
set  corresponding  to  each  aircraft  subsystem  studied.  This  effort 
resulted  in  the  derivation  of  thirty  composite  Maintenance  Metrics  and 
Weightings  Models  for  the  estimation  of  maintenance  action  demand.  The 
form  of  the  models  is  as  follows: 

MAD  *  A+fB^Equip  Param^. . .+BmEquip  Parang)  + 

+(C10pnl  Param^. .  .+Cn0pnl  Param^)*.. 

. .+(D, Environ  Param.+. . .+D  Environ  Param  ). 

1  1  p  p 

Table  19  lists  the  specific  equipment,  operational,  and 
environmental  characteristic  parameters  which  enter  the  "Composite"  ' 
model  for  each  subsystem.  A  summary  list  of  these  thirty  complete  model 
equations  are  included  in  Appendix  E  of  this  report.  Complete  details 
and  listing  of  the  composite  models  may  be  found  in  Boeing  Interim  * 
Technical  Report  D194-10089-3  (Reference^™ . 


Q])  "Development  of  Maintenance  Metrics  to  Forecast  Resource  Demands 
'  of  Weapon  Systems  (Maintenance  Metrics  and  Weightings," 
0194-10089-3,  Boeing  Aerospace  Company,  Seattle,  Washington, 
January  1080. 
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TABLE  19  SUBSYSTEM  MAD  AS  A  COMPOSITE  FUNCTION  OF  EQUIPMENT, 
OPERATIONAL,  AND  ENVIRONMENTAL  PARAMETERS 
_ _ (Sheet  1) _ 


SUBSYSTEM 

EQUIPMENT,  OPERATIONAL,  AND 

ENVIRONMENTAL  PARAMETERS 

ENTERING  MAD  ESTIMATION  EQUATION 

Propulsion  System 

P02  -  Total  Number  of  Installed  Engines  per 
Aircraft 

P04  -  Weight  per  Engine 

010  -  Average  Cruise  Altitude 

027  -  Operational  Sorties  per  Aircraft 

032  -  Aircraft  Crew  Size 

033  -  Average  Sortie  Length 

Flight  Indicators 

A03  -  Equipment  Weight 

013  -  Minimum  Landing  Distance 

017  -  Operations  Flying  Hours  per  Aircraft 

E03  -  Runway  Direction 

El 9  -  Days  per  Year  Max.  Crosswinds  20-29  MPH 

Air  Data  System 

A03  -  Equipment  Weight 

A16  -  On/Off  Cycles  per  Flying  Hour 

008  -  Average  Climb  Rate 

013  -  Minimum  Landing  Distance 

023  -  Average  Number  of  Alert  Aircraft 

El 3  -  Number  of  Thunder  Days  per  Year 

El 9  -  Days  per  Year  Max.  Crosswinds  20-29  MPH 

Horizontal  Situation 
Indicator 

A07  -  Cooling  Method 

A16  -  On/Off  Cycles  per  Flying  Hour 

014  -  Average  Landing  Weight 

033  -  Average  Sortie  Length 

E20  -  Days  per  Year  Max.  Crosswinds  30-39  MPH 

Autopilot 

A03  -  Equipment  Weight 

A04  -  Equipment  Volume 

A13  -  Average  Operating  Time  per  Sortie 

A19  -  Failure/Abort  Ratio 

008  -  Average  Climb  Rate 

023  -  Average  Number  of  Alert  Aircraft 

El 8  -  Days  per  Year  Max.  Crosswinds  10-19  MPH 

NOTE:  SEE  APPENDIX  E  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS. 
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TABLE  19  SUBSYSTEM  MAD  AS  A  COMPOSITE  FUNCTION  OF  EQUIPMENT, 
OPERATIONAL,  AND  ENVIRONMENTAL  PARAMETERS 

_ (Sheet  2) _ _ 


SUBSYSTEM 

EQUIPMENT,  OPERATIONAL,  AND 

ENVIRONMENTAL  PARAMETERS 

ENTERING  MAD  ESTIMATION  EQUATION 

UHF  Communications 

Set 

A03  -  Equipment  Weight 

A05  -  Number  of  SRU's  per  Unit 

008  -  Average  Climb  Rate 

018  -  Miscellaneous  Flying  Hours  per  Aircraft 

El 8  -  Days  per  Year  Max.  Crosswinds  10-19  MPH 
£19  -  Days  per  Year  Max.  Crosswinds  20-29  MPH 

E30  -  Average  Type  of  Vision  Obstruction 

IFF  Transponder  Set 

A02  -  Equipment  Location  on  Aircraft 

A09  -  Number  of  Test  Points  on  Unit 

030  -  Maximum  Aircraft  Speed 

E09  -  Number  of  Rain  Days  per  Year 

Inertial  Navigation 

Set 

A05  -  Number  of  SRU's  per  Unit 

Instrument  Landing 

Set 

AOS  -  Operating  Emperature 

015  -  Total  Flying  Hours  per  Aircraft 

027  -  Operations  Sorties  per  Aircraft 

E20  -  Days  per  Year  Max.  Crosswinds  30-39  MPH 

TACAN  Set 

A03  -  Equipment  Weight 

A18  -  Ground/Flight  Operating  Ratio 

032  -  Aircraft  Crew  Size 

E03  -  Runway  Direction 

E09  -  Number  of  Rain  Days  per  Year 

E20  -  Days  per  Year  Max.  Crosswinds  30-39  MPH 

Attitude-Heading 
Reference  Set 

A08  -  Protective  Method 

005  -  Average  Take-Off  Speed 

E27  -  Days  per  Year  Min.  Temp.  Below  32°  F 

Radar  Set 

A02  -  Equipment  Location  on  Aircraft 

A12  -  AGE  Unreliability 

A19  -  Failure/Abort  Ratio 

011  -  Average  Descent  Rate 

El  3  -  Number  of  Thunder  Days  per  Year 

E20  -  Days  per  Year  Max.  Crosswinds  30-39  MPH 

NOTE:  SEE  APPENDIX  E  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS. 
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TABLE  19  SUBSYSTEM  MAD  AS  A  COMPOSITE  FUNCTION  OF  EQUIPMENT. 
OPERATIONAL,  AND  ENVIRONMENTAL  PARAMETERS 

_ _ (Sheet  3) _ 


SUBSYSTEM 

EQUIPMENT,  OPERATIONAL,  AND 

ENVIRONMENTAL  PARAMETERS 

ENTERING  MAD  ESTIMATION  EQUATION 

Radome 

F08  -  Type  of  Failure  Problems  Predominant 

005  -  Average  Take-Off  Speed 

021  -  Operations  Landings  per  Aircraft 

E18  -  Days  per  Year  Max.  Crosswinds  10-19  MPH 

Windshield 

F07  -  Support  Equipment  Reliability 

015  -  Total  Flying  Hours  per  Aircraft 

021  -  Operations  Landings  per  Aircraft 

027  -  Operations  Sorties  per  Aircraft 

El 8  -  Days  per  Year  Max.  Crosswinds  10-19  MPH 

Wings 

F04  -  Equipment  Volume 

008  -  Average  Climb  Rate 

012  -  Average  Landing  Speed 

014  -  Average  Landing  Weight 

021  -  Operations  Landings  per  Aircraft 

El  3  -  Number  of  Thunder  Days  per  Year 

E20  -  Days  per  Year  Max.  Crosswinds  30-39  MPH 

Cockpit  Furnishings 

008  -  Average  Climb  Rate 

012  -  Average  Landing  Speed 

017  -  Operations  Flying  Hours  per  Aircraft 

021  -  Operations  Landings  per  Aircraft 

025  -  Total  Sorties  per  Aircraft 

027  -  Operations  Sorties  per  Aircraft 

El 9  -  Days  per  Year  Max.  Crosswinds  20-29  MPH 

Main  Landing  Gear 

F03  -  Equipment  Weight 

F06  -  Support  Equipment  Complexity 

FI 3  -  Removals  to  Access  Other  Equipment 

014  -  Average  Landing  Weight 

019  -  Total  Landings  per  Aircraft 

Brakes 

F09  -  Inflight  Squawk  Verification  Rate 

003  -  Average  Mission  Mix 

005  -  Average  Take-Off  Speed 

026  -  Training  Sorties  per  Aircraft 

031  -  Service  Aircraft  Ceiling 

E03  -  Runway  Direction 

NOTE:  SEE  APPENDIX  E  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS 


a. 
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TABLE  19  SUBSYSTEM  MAD  AS  A  COMPOSITE  FUNCTION  OF  EQUIPMENT, 
OPERATIONAL,  AND  ENVIRONMENTAL  PARAMETERS 

_ (Sheet  4) _ 


SUBSYSTEM 

EQUIPMENT,  OPERATIONAL,  AND 

ENVIRONMENTAL  PARAMETERS 

ENTERING  MAD  ESTIMATION  EQUATION 

Stabilator 

F03  -  Equipment  Weight 

F06  -  Support  Equipment  Complexity 

021  -  Operations  Landings  per  Aircraft 

E20  -  Days  per  Year  Max.  Crosswinds  30-39  MPH 

Rudder 

015  -  Total  Flying  Hours  per  Aircraft 

034  -  Accidents  (Major/Minor)  per  Aircraft 

E03  -  Runway  Direction 

Flaps 

F03  -  Equipment  Weight 

F06  -  Support  Equipment  Complexity 

F08  -  Predominant  Type  of  Failure  Problems 

015  -  Total  Flying  Hours  per  Aircraft 

027  -  Operations  Sorties  per  Aircraft 

E18  -  Days  per  Year  Max.  Crosswinds  10-19  MPH 

El 9  -  Days  per  Year  Max.  Crosswinds  20-29  MPH 

Environmental  Control 
System 

El 9  -  Days  per  Year  Max.  Crosswinds  20-29  MPH 
E24  -  Mean  Minimum  Temperature 

Electric  Power 
Generation 

FI 3  -  Removals  to  Access  Other  Equipment 

007  -  Average  Take-Off  Weight  as  %  of  Maximum 

Anti -Colli si on  Lights 

F03  -  Equipment  Weight 

F06  -  Support  Equipment  Complexity 

011  -  Average  Descent  Weight 

021  -  Operations  Landings  per  Aircraft 

025  -  Total  Sorties  per  Aircraft 

027  -  Operations  Sorties  per  Aircraft 

E30  -  Average  Type  of  Vision  Obstruction 

Landing/Taxi  Lights 

F03  -  Equipment  Weight 

FI 3  -  Removals  to  Access  Other  Equipment 

015  -  Total  Flying  Hours  per  Aircraft 

El 8  -  Days  per  Year  Max.  Crosswinds  10-19  MPH 

El 9  -  Days  per  Year  Max.  Crosswinds  20-29  MPH 

NOTE:  SEE  APPENDIX  E  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS. 


TABLE  19  SUBSYSTEM  MAD  AS  A  COMPOSITE  FUNCTION  OF  EQUIPMENT, 
OPERATIONAL,  AND  ENVIRONMENTAL  PARAMETERS 
(Sheet  5) 


SUBSYSTEM 

EQUIPMENT,  OPERATIONAL,  AND 

ENVIRONMENTAL  PARAMETERS 

ENTERING  MAD  ESTIMATION  EQUATION 

Hydraulic  Power 

System 

FI  1  -  Ground/Flight  Operating  Ratio 

008  -  Average  Climb  Rate 

014  -  Average  Landing  Weight 

032  -  Aircraft  Crew  Size 

033  -  Average  Sortie  Length 

E06  -  Number  of  Snow  Days  per  Year 

E08  -  Mean  Snow  Depth 

Internal  Fuel  System 

FI 6  -  Equipment  Protection  Methodology 

010  -  Average  Cruise  Altitude 

015  -  Total  Flying  Hours  per  Aircraft 

021  -  Operations  Landings  per  Aircraft 

027  -  Operations  Sorties  per  Aircraft 

El 8  -  Days  per  Year  Max.  Crosswinds  10-19  MPH 

El 9  -  Days  per  Year  Max.  Crosswinds  20-29  MPH 

Oxygen  Regulator 

F03  -  Equipment  Weight 

030  -  Maximum  Aircraft  Speed 

E06  -  Number  of  Snow  Days  per  Year 

E07  -  Total  Snow  Fall  per  Year 

E21  -  Days  per  Year  Max.  Crosswinds  40-49  MPH 

E24  -  Mean  Minimum  Temperature 

E27  -  Days  per  Year  Min.  Temp.  Below  32°  F 

LOX  Converter 

F08  -  Predominant  Type  of  Failure  Problems 

005  -  Average  Take-Off  Speed 

006  -  Median  Take-Off  Distance 

033  -  Average  Sortie  Length 

Engine  Fire  Detection 

F08  -  Predominant  Type  of  Failure  Problems 

El 6  -  Predominant  Wind  Direction 

El 9  -  Days  per  Year  Max.  Crosswinds  20-29  MPH 

E24  -  Mean  Minimum  Temperature 

NOTE:  SEE  APPENDIX  E  FOR  A  LISTING  OF  COMPLETE  MAD  ESTIMATING  EQUATIONS. 
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7.3 


DEVELOPMENT  OF  LCOM  FAILURE  CLOCK  CALCULATION 
ROUTINE  -  SUBTASK  6  &  7.6 


The  maintenance  action  demand  estimations  obtained  from  the 
Maintenance  Metrics  and  Weightings  Models  discussed  in  7.1  and  7.2  are 
in  terms  of  maintenance  actions  per  unit  equipment  per  year.  One  of 
the  principle  requirements  of  Tasks  VI  and  VII  is  to  translate  these 
estimations  into  Failure  Clock  values  for  control  of  LCOM  subsystem 
maintenance  networks.  Since  these  F-clock  values  are  usually  some 
derivative  of  "number  of  sorties  to  maintenance  action,"  a  computational 
routine  for  accomplishing  this  translation  is  required.  Figure  17  is 
a  process  flow  depicting  this  routine.  The  detailed  procedure  for 
accomplishing  the  F-clock  transformation  follows. 

PROCEDURE  FOR  TRANSFORMING  PRESENT  LCOM 
“FATLURE  CLOCK  VALUES  TO  CONFORM  WITH 
MAINTENANCE  METRICS  MODEL  ESTIMATES 

(1)  Determine  actual  historical  time  period  used  to  derive  present 
LCOM  values. 

(2)  Determine  actual  maintenance  action  demand  (AMAD)  of  subsystem  of 
interest  during  that  time  period.  Determine  partial  maintenance 
action  demand  (PAMAD)  of  subsystem  critical  equipment  used  to 
derive  maintenance  metrics  model  equation. 

(3)  Determine  appropriate  "operating  point"1  values  for  item's  Metrics 
Model  regression  variables.  These  values  may  either  be  derived 
from  historic  design  and  scenario  data  or  from  new  simulated  design 
and  scenario  data  as  appropriate  depending  on  the  nature  of  the 
simulation  experiments  to  be  performed. 

(4)  Compute  partial  estimated  maintenance  action  demand  (PEMAD)  for  the 
same  historic  time  period  using  Maintenance  Metrics  Regression 
Model.  Scale  this  result  up  to  total  subsystem  estimated  main¬ 
tenance  demand  (EMAD)  by  multiplying  by  the  AMAD/PAMAD  ratio. 

(5)  Compute  ratio  of  EMAD  to  AMAD. 


NOTE: 


1  -  Operating  point  is  defined  here  as  the  system  of  design,  operational 
support,  and  environmental  conditions  applicable  to  the  item-of- 
interest.  This  may  be  some  actual  historic  operating  point 
featuring  retrospective  data,  a  predicted  operating  point  featuring 
prospective  estimates,  or  it  may  be  a  mixture  of  the  two. 
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LCOM  SIMULATION  PROBLEM 
o  F-CLOCK  LIST 
o  OPERATING  SCENARIO 


(6)  Multiply  present  clock  values  (or  decrement  value  if  appropriate) 
by  the  EMAD/AMAD  rati02  to  transform  clock  value  to  the  maintenance 
Metric  based  estimate. 

(7)  If  new  clock  value  is  to  be  substituted  into  an  existing  LCOM  input 
model  and  it  is  desired  not  to  disturb  the  existing  input  data  base, 
add  a  clock  change  card  to  the  LCOM  simulation  control  deck 
designating  the  appropriate  clock  number  and  new  clock  value. 

The  requirement  for  and  explanation  of  this  rather  complicated  procedure 
is  as  follows: 

The  generic  and  composite  Maintenance  Metrics  and  Weightings 
regression  equations  developed  for  the  study  were  based  on  a  sampling  of 
the  critical  equipment  items  in  each  aircraft  subsystem.  Critical  equip¬ 
ments  are  considered  to  be  those  items  (usually  only  one  or  two)  within 
a  subsystem  which  drive  the  maintenance  resource  demands  of  that  sub¬ 
system  and  may  be  used  to  represent  the  total  subsystem  without  serious 
degradation  of  maintenance  metrics  analysis  results.  Critical  equipments 
rather  than  total  subsystems  were  used  for  maintenance  metrics  develop¬ 
ment  because  the  far  greater  time  and  resources  required  for  the  data 
gathering  and  analysis  of  each  item  in  each  subsystem  could  not  De 
justified  in  terms  of  the  increased  accuracy  of  the  metrics  developed 
(Refer  to  Sections  3  and  5  of  this  report  for  discussions  of  subsystem 
equipment  selection  and  data  acquisition) .  Therefore,  as  shown  in 
Figure  17  and  the  procedure,  transforming  the  outputs  of  the  regression 
models  to  F-clock  values  provides  for  scaling  the  partial  MAD  estimates 
based  on  the  selected  equipment  items  up  to  total  subsystem  MAD  estimates 
for  LCOM  network  control,  since  the  LCOM  maintenance  networks  are 
structured  at  the  subsystem  level  and  the  F-clock  values  are  based  on 
total  subsystem  demands.  This  is  accomplished  through  the  utilization 
of  an  actual  sample  of  historical  maintenance  action  demand  data  for  the 
subsystems  (or  similar  subsystems  if  new  equipment)  being  analyzed  and 
simulated.  This  actual  data  is  used  to  calculate  a  ratio  factor  of 
total  subsystem  MAD  to  selected  equipment  sample  MAD.  This  total  sub¬ 
system  MAD  scale  factor  can  then  be  applied  to  the  partial  MAD  estimates 


NOTE: 

2  -  The  Maintenance  Metrics  Models  are  of  greatest  value  when  performing 
prospective  simulation  and  analyses  on  new  systems  and/or  new 
scenarios.  Under  these  conditions  it  is  postulated  that  they  will 
provide  better  results  than  simplistic  projections  of  historic 
failures  per  sortie  or  per  flying  hour.  If,  however,  an  exact 
historical  scenario  is  being  simulated  (a  retrospective  analysis 
of  what  actually  happened),  the  historical  data  should  provide 
better  results  than  the  "fitted"  Maintenance  Metrics  estimates. 


94 

D1 94-1 0089-5 


OQ  MOO  2  140  0*10.  4/ ?  t 


computed  from  the  regression  models  of  the  new  aircraft  and/or  basing 
situation  being  simulated  to  yield  total  subsystem  MAD  estimates  for 
translation  into  F-clock  values  at  the  LCOM  maintenance  network  level. 

The  last  step  in  the  translation  process  is  to  obtain  an  estimate  of 
sorties  per  year  to  be  accomplished  (usually  obtained  from  the  simulation 
scenario)  and  to  calculate  the  sorties-to-failure  values  corresponding 
to  each  subsystem  MAD  per  year.  A  sample  of  the  calculation  work  sheet 
to  be  used  for  the  F-clock  computation  routine  and  a  typical  example  of 
the  application  of  this  procedure  to  the  F-15A/Bitburg  baseline  LCOM 
are  included  in  Appendix  F  of  this  report. 

7.4  DEVELOPMENT  OF  MAINTENANCE  TASK  PROBABILITY  ESTIMATING 

MODELS  -  SUBTASK  6  &  7.8 


The  last  subtask  to  be  accomplished  within  the  Task  VI  and 
VII  effort  was  the  development  of  an  estimating  method  for  the  main¬ 
tenance  task  selection  probabilities  necessary  for  the  control  of  the 
LCOM  maintenance  networks.  The  process  flow  for  this  subtask  was  as 
depicted  by  Figure  18  and  as  shown,  task  frequency  data  was  extracted 
from  the  data  base  collected  in  study  task  IV  (see  Section  5.0).  This 
data  was  extracted  at  both  the  subsystem  and  included  equipment  levels 
for  each  data  case  of  the  study  (aircraft/base  combination)  for  each 
of  the  thirty  aircraft  subsystems  studied.  The  data  was  then  utilized 
to  compute  weighted  average  maintenance  task  selection  probabilities 
for  each  subsystem/aircraft/base  combination.  The  weighting  factors 
were  based  on  the  ratio  of  frequency  of  maintenance  of  each  equipment 
item  within  a  given  subsystem  to  the  frequency  of  maintenance  of  the 
subsystem  as  a  whole.  It  is  necessary  to  weight  the  task  frequencies 
of  the  component  equipments  because  the  equipment  items  within  a  sub¬ 
system  do  not  fail  with  equal  frequency  and  therefore  the  task  distri¬ 
butions  on  the  various  subsystem  components  must  be  weighted  according 
to  each's  proportion  of  total  subsystem  failures. 

The  weighted  average  task  selection  probabilities  discussed 
above  were  then  assembled  in  summary  data  sets  by  subsystem  and  the 
mean,  median,  mode  and  range  of  the  probability  of  occurrence  of  each 
task  type  computed  for  each  aircraft  subsystem.  These  resulting 
statistics  can  now  be  used  to  estimate  the  expected  task  selection  . 
probability  distributions  required  for  control  of  the  various  subsystem 
maintenance  networks  in  LCOM  simulation  problems.  Figure  19  is  an 
overview  of  the  foregoing  analysis  process.  Table  20  presents  a 
summary  of  the  resulting  mean  task  selection  probability  distributions 
for  the  various  subsystems.  Complete  details,  data  and  statistics  used 
to  develop  the  task  selection  probabilities  may  be  found  in  Boeing 
Interim  Technical  Report  0 194- 10089-3  (Reference/m) . 
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DEVELOP  MEAN  PROBABILITY  PREDICTIONS  FOR  LCOM  MAINTENANCE  NETWORK  TASK  ALTERNATIVES 
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FIGURE  19  MAINTENANCE  TASK  SELECTION  PROBABILITY  ANALYSIS  OVERVIEW 


TABLE  20  SUMMARY  OF  MEAN  TASK  SELECTION  PROBABILITY  DISTRIBUTIONS 


AIRCRAFT 

EQUIPMENT  SUBSYSTEM 


ON  EQUIPMENT 
MEAN  TASK  PROBABILITY 
DISTRIBUTION 


R 

REMOVE 


M 

FIX 


H 

CHK  OK 


OFF  EQUIPMENT 
MEAN  TASK  PROBABILITY 
DISTRIBUTION 


N 

SENT  ON 


K 

CHK  OK 


W 

FIX 


23000  Propulsion 


0.339 


0.S36 


0.125 


0.388 


0.138 


0.474 


51A00  Flight  Indicators 


0.571 


0.343 


0.086 


0.768 


0.146 


0.086 


51E00  Air  Data  System 


0.414 


0.436 


0.150 


0.509 


0.205 


0.286 


51N00  Horizontal  Situation  Indie. 


0.586 


0.226 


0.188 


0.699 


0.149 


0.152 


52A00  Autopilot 


0.573 


0.208 


0.219 


0.354 


0.246 


0.400 


63AOO  UHF  Conmun lection  Set 


0.529 


0.343 


0.128 


0.168 


0.120 


0.712 


65A00  IFF  Transponder  Set 


0.540 


0.219 


0.241 


0.105 


0.232 


0.663 


71A00  Inertial  Navigation  Set 


0.390 


0.119 


0.491 


0.343 


0.171 


0.486 


71C00  Instrument  Landing  Set 


0.421 


0.310 


0.269 


0.069 


0.158 


0.773 


71D00  TACAN  Set 


0.650 


0.174 


0.176 


0.182 


0.200 


0.618 


71FOO  Attitude-Heading  Ref.  Set 


0.650 


0.157 


0.193 


0.661 


0.193 


0.146 


74FOO  Radar  Set 


0.496 


0.183 


0.321 


0.220 


0.113 


0.667 


11A01  Radome  Assembly 


0.147 


0.837 


0.016 


0.067 


0.933 


11A02  Windshield 


0.142 


0.820 


0.038 


0.124 


0.876 


11KOO  Wings 


0.128 


0.859 


0.013 


0.056 


0.038 


0.906 


12800  Cockpit  Furnishings 


0.154 


0.775 


0.071 


0.450 


0.009 


0.541 


13A0Q  Main  Landing  Sear 


0.713 


0.014 


0.273 


0.317 


0.548 


0.135 


13000  Brake  Subsystem 


0.373 


0.424 


0.203 


0.425 


0.188 


0.387 


14C00  Stabile tor  Subsystem 


0.163 


0.716 


0.121 


0.424 


0.116 


0.460 


14000  Rudder  Subsystem 


0.201 


0.534 


0.265 


0.307 


0.159 


0.534 


14H00  Flap  Subsystem 


0.154 


0.620 


0.226 


0.412 


0.013 


0.575 


41A00  Environmental  Control  System 


0.499 


0.408 


0.093 


0.404 


0.062 


0.534 


42A00  Electric  Power  Sen.  System 


0.391 


0.569 


0.040 


0.445 


0.193 


0.362 


44 API  Navigation  Lights 


0.440 


0.549 


0.011 


0.174 


0.028 


0.798 


44A02  Landing/Taxi  Lights 


0.365 


0.628 


0.007 


0.285 


0.027 


0.688 


45A00  Hydraulic  Power  System 


0.257 


0.599 


0.144 


0.532 


0.252 


0.216 


46A00  Internal  Fuel  Subsystem 


0.187 


0.661 


0.152 


0.683 


0.050 


0.267 


47A01  Oxygen  Regulator 


0.656 


0.258 


0.086 


0.923 


0.024 


0.053 


47A0a  LOX  Converter 


0.545 


0.372 


0.083 


0.772 


0.145 


0.083 


A9AOO  Fire  Detection  System 


0.338 


0.606 


0.056 


0.550 


0.182 


0.268 
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8.0  ANALYSIS  AND  RESULTS  OF  METRICS  AND  WEIGHTINGS  -  TASK  VIII 

Task  VIII  of  the  study  was  the  planning,  execution,  and 
analysis  of  validation  experiments  for  the  new  maintenance  metrics  and 
weightings  developed  during  the  preceding  study  tasks.  These  experi¬ 
ments  were  performed  on  operative  LOOM  simulations  of  operational 
aircraft  systems.  The  validation  experiments  were  intended  to  demon¬ 
strate  the  validity  of  the  new  metrics  and  to  indicate  an  approximate 
confidence  level  for  their  use. 

The  subtasks  accompli  shed  for  these  validation  experiments 
are  as  shown  in  Figure  20  and  discussed  in  the  following  paragraphs. 

The  approach  taken  for  the  validation  of  the  maintenance 
metrics  developed  during  the  preceding  study  tasks  was  to  exercise 
the  newly  developed  metrics  in  known  historical  situation  simulations 
and  subsequently  evaluate  the  success  of  these  new  metrics  in  producing 
similar  simulation  results  as  the  actual  historical  data.  The  ability 
of  the  new  maintenance  metrics  to  duplicate  the  results  of  actual 
historical  data  is  a  measure  of  the  worth  of  these  metrics  in  predicting 
maintenance  resource  demands  for  emerging  weapon  systems  under  new 
operational  and  environmental  conditions. 

The  metrics  validation  was  planned  and  performed  in  two  parts. 
First  a  series  of  LCOM  simulation  experiments  was  accomplished  using  a 
model  of  an  aircraft/base  combination  (the  F-15A  at  Bitburg  Air  Base) 
which  was  part  of  the  study  data  base  from  which  the  maintenance  metric 
equations  were  developed.  A  second  series  of  LCOM  experiments  was  then 
performed  which  used  a  model  and  aircraft/base  combinations  which  were 
not  part  of  the  original  metrics  study  data  base.  The  model  used  for 
this  second  validation  effort  was  the  standard  ASD  KC-135A  LCOM.  The 
input  data  module  for  this  model  was  developed  from  five  KC-135A  base 
samples  not  considered  in  the  metrics  study;  i.e.,  Altus,  Blytheville, 
Grand  Forks,  Griffiss,  and  K.  I.  Sawyer.  Then,  to  decouple  this  second 
experiment  series  even  further  from  the  original  metrics  study  data 
base,  the  bases  chosen  for  simulation  were  neither  part  of  the  metrics 
study  data  base  nor  of  the  ASD  standard  data  base;  i.e.,  Loring, 
Seymour-Johnson,  and  Castle.  This  was  done  to  test  the  performance  of 
the  new  metrics  in  situations  which  were  clearly  outside  the  statistical 
data  used  for  their  derivation. 

The  initial  validation  experiments  were  performed  using  the 
ASD/McDonnell  Douglas  LCOM  simulation  of  the  F-15A  aircraft  at  Bitburg 
Air  Base  as  the  baseline  model.  This  model  was  first  executed  with  the 
standard  failure  clocks  which  were  derived  from  the  historical  data  base 
on  F-15A/Bitburg.  Then  a  series  of  experimental  simulation  runs  were 
executed  using  the  maintenance  metrics  and  weightings  developed  during 
this  study  to  set  the  model's  failure  clocks.  The  results  of  the 
experimental  simulations  were  then  compared  with  the  standard  simulations 
in  order  to  evaluate  the  worth  of  the  newly  developed  maintenance 
metrics  for  the  estimation  of  aircraft  systems  maintenance  resource 
demands . 
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FIGURE  20  TASK  VIII  PROCESS  FLOW 


In  the  initial  series  of  experimental  model  runs,  mainte¬ 
nance  metrics  for  the  aircraft  propulsion  system  and  eleven  avionic 
systems  were  exercised.  The  results  of  this  initial  series  indicated 
that  the  avionics  metrics  were  acceptable  for  use  in  predicting  new 
situations  with  only  approximately  10%  deviation  from  the  simulation 
results  given  by  the  actual  historical  data.  The  propulsion  system 
metric  indicated  a  need  for  further  investigation  and  possible  refine¬ 
ment  since  its  introduction  into  the  baseline  simulation  model  caused 
wide  variations  from  the  actual  historical  propulsion  data. 

A  more  extensive  series  of  validation  experiments  was 
then  performed  which  exercised  the  developed  metrics  for  all  thirty 
aircraft  subsystems  investigated.  A  standard  ASD  LCOM  simulation  of  the 
KC-135A  aircraft  was  used  to  simulate  three  different  bases  with 
varying  environments  and  operational  modes,  i.e.;  Loring  AFB,  Maine, 
a  two  squadron  operational  base;  Seymour-Johnson  AFB,  North  Carolina, 
a  single  squadron  operational  base;  and  Castle  AFB,  California,  a  two 
squadron  training  base.  These  squadrons  were  first  simulated  using  the 
ASD  developed  standard  metrics  with  base-specific  flying  programs. 

Then  the  simulations  were  repeated  using  the  newly  developed  maintenance 
metrics  from  this  study.  Finally,  metrics  derived  from  actual  base- 
specific  historical  data  were  inserted  and  the  simulations  run  again  to 
form  a  basis  for  comparison.  Output  flying  and  maintenance  parameters 
from  the  three  sets  of  simulations  of  each  base  were  compared  for 
deviations.  The  simulation  results  from  the  base-specific  historical 
metrics  were  taken  as  baselines.  These  baseline  simulation  results 
were  in  turn  compared  to  actual  flying  and  maintenance  histories  at 
the  subject  bases  as  extracted  from  the  Air  Force  G033B  and  D056E  data 
systems . 


The  results  of  this  second  series  of  metrics  validation 
experiments  exhibited  quite  low  deviations.  The  simulations  based  on 
metrics  values  differed  less  than  3%  for  Loring  and  Castle  AFB's  and 
less  than  9%  for  Seymour-Johnson  AFB  from  the  simulations  based  on 
historic  base  values.  The  overall  fidelity  of  the  KC-135A  LCOM  was. 
also  good.  The  deviation  of  the  Loring  baseline  simulation  results  was 
less  than  8%  from  actual  historic  flying  and  maintenance  records  while 
the  corresponding  deviations  for  Seymour-Johnson  and  Castle  were  less 
than  10%  and  less  than  15%  respectively.  These  results  present  soli'd 
evidence  of  the  acceptability  of  the  new  maintenance  metrics  for  use  in 
predicting  maintenance  requirements  in  new  situations. 

Complete  details  and  data  pertaining  to  the  Task  VIII  study 
effort  are  contained  in  Boeing  Interim  Technical  Report  D1 94-1 0089-4 
(Referencenj))  and  are  summarized  in  the  remainder  of  Section  8. 
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8.1 


SELECTION  OF  BASELINE  LCOM  INPUT  MODEL  -  SUBTASK  8.1 


The  first  step  in  the  process  of  analyzing  the  results  of 
metrics  and  weightings  development  effort  of  the  preceding  study  tasks 
was  the  selection  of  operative  LCOM  simulations  in  which  to  test  the 
newly  developed  metrics.  Existing  Air  Force  LCOM  simulations  were 
investigated  and  the  ASD/McDonnell  Douglas  model  of  the  F-15A  aircraft 
at  Bitburg  Air  Base  selected  for  the  initial  series  of  metrics  valida¬ 
tion  experiments.  The  model  selected  for  subsequent  series  of  experiments 
was  the  standard  ASD  model  of  the  KC-135A  aircraft. 

Input  models  and  flying  programs  for  the  selected  models 
were  implemented  on  the  ITEL  computer  system  in  the  ASD  Computer  Center 
at  Wright-Patterson  Air  Force  Base,  Dayton,  Ohio.  The  model  data  were 
based  on  1977  experience  data  the  same  as  the  present  study. 

8.2  BASELINE  MODEL  SIMULATION  RUNS  USING  CURRENT  METRICS  AND 
nei£HtiNGs  -  sUbYask  37? 

After  implementation  of  the  baseline  models  on  the  ASD 
computing  system,  simulation  runs  were  executed  using  the  failure  clock 
values  currently  operational  in  the  input  data  bases  for  the  models. 

These  runs  served  to  calibrate  the  natural  variability  of  the  baseline 
simulations  and  to  establish  a  basis  for  comparison  of  the  results  of 
the  later  validation  experiments  which  utilized  the  newly  developed 
F-clock  metrics.  In  addition,  base-specific  baselines  were  established 
for  the  KC-l35A/Loring,  Seymour-Johnson,  and  Castle  AFB  simulation  series. 

8.3  TRANSFORMATION  OF  BASELINE  LCOM  FAILURE  CLOCKS  - 
SUBTASK  8.3 


The  next  step  of  the  validation  process  was  to  implement 
the  procedure  for  transforming  the  baseline  failure  clock  values  in 
the  test  models  to  values  computed  from  the  F-clock  estimation  equations 
developed  in  preceding  study  tasks  VI  and  VII  (see  Section  7).  The 
procedure  developed  utilized  the  "change-card"  capability  of  the  LCOM 
control  software  so  as  to  facilitate  ease  of  testing  various  combinations 
of  modified  clock  values  without  disturbance  to  the  basic  baseline 
Input  Data  Model.  This  procedure  has  been  described  in  detail  in  sub¬ 
section  7.3  and  Appendix  F  of  this  report. 

Initially,  the  procedure  was  applied  to  the  propulsion 
and  eleven  of  the  avionics  failure  clocks  of  the  F-15A/Bitburg  baseline 
model.  The  resulting  F-clock  values  and  their  implications  for  the 
baseline  F-15A/Bitburg  LCOM  are  summarized  in  Table  21.  Baseline  values 
for  the  subject  F-clocks  had  been  calculated  from  1977  Bitburg  data 
prior  to  the  model's  use  in  the  metrics  study.  The  values  for  the 
regression  variables  were  obtained  from  the  F-15A/Bitburg  entries  in 
the  Maintenance  Metrics  study  data  base.  These  transformed  F-clocks  were 
used  according  to  the  validation  experiment  plan  presented  in  following 
subsection  8.4. 
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APPLICATION  OF  METRIC  MODELS  TO  F-15A  CBITBURG) 
LCOM  FAILURE  CLOCKS  (PHASE  I  EQUIPMENTS) 


The  F-clock  transformation  procedure  was  then  applied  to 
all  30  aircraft  subsystems  studied  for  the  LOOM  simulations  of  the  three 
selected  KC-135A  bases.  The  simulation  model  used  for  these  experiments 
contained  generic  ASD  standard  F-clock  values  derived  from  a  composite 
of  five  representative  KC-135A  bases;  i.e.,  Altus,  Blytheville,  Grand 
Forks,  Griffiss,  and  K.  I.  Sawyer.  Therefore  it  was  necessary  to 
calculate  sets  of  base-specific  baseline  F-clock  values  for  the  three 
study  bases;  Loring,  Seymour-dohnson,  and  Castle.  Sortie  and  failure 
data  from  the  year  1977  were  used  for  this  purpose.  The  D056E,  G033B, 
and  KC-135A  source  data  used  for  calculation  of  the  baseline  failure 
clocks  and  also  for  use  in  the  F-clpck  transformation  regression 
equations  is  included  in  Referenceu8).  These  baseline  F-clock  values 
were  then  imposed  on  the  existing  gCTeric  ASD  KC-135A  model  via  appro¬ 
priate  clock  change  cards  for  the  base-specific  baseline  simulation 
runs. 


The  thirty  study  equipment  failure  clocks  were  then  trans¬ 
formed  to  the  maintenance  metrics  values  for  the  metrics  validation 
experiments.  The  values  for  the  regression  variables  were  obtained  from 
the  subject  base  entries  in  the  1977  G033B,  D056E,  and  Air  Weather 
Service  data  for  maintenance  demand,  operations,  and  environmental 
variables.  KC-135A  equipment  design  characteristic  data  were  obtained 
from  the  Maintenance  Metrics  study  data  base.  Table  22  contains  a  summary 
of  the  ASD  standard,  baseline,  and  metrics  derived  F-clock  values  for 
each  of  the  study  bases.  The  validation  experiment  plan  based  on  these 
transformed  F-clock  values  is  given  in  subsection  8.4. 

8.4  NEW  METRICS  AND  WEIGHTINGS  VALIDATION  EXPERIMENTS  - 

SUBTAsk  8'. 4' 

Series  of  simulation  experiments  were  planned  and  executed 
with  the  F-15A  and  KC-135A  models  to  demonstrate  the  validity  of  the 
new  metrics.  Figure  21  depicts  the  general  procedure  followed  in  the 
execution  of  these  validation  plans. 

An  initial  series  of  LCOM  simulation  experiments  was 
performed  to  evaluate  the  F-clock  estimation  equations  for  propulsion 
and  avionics  and  their  implications  for  F-15A/Bitburg  model.  Figure  22 
gives  the  simulation  plan  for  this  series. 

The  objective  of  these  experiments  was  to  determine  how 
well  the  generalized  F-clock  estimating  models,  which  were  derived 
from  an  Air  Force-wide  population  of  aircraft  and  bases,  could  duplicate 
simulation  results  based  on  actual  historical  failures  per  sortie  data 
from  a  specific  aircraft  (F-15A),  a  specific  base  (Bitburg),  and  a 
specific  time  period  (1977).  This  determination  is  a  measure  of  the 
confidence  that  can  be  placed  in  the  estimating  equations  when  used  in 
a  new  situation  or  for  an  emerging  weapon  system.  The  determination  was 
made  by  exercising  the  F-15A/Bitburg  LCOM  simulation  with  the  new  F- 
clock  values  singly  and  in  combination.  The  results  of  these  simulations 
were  then  compared  to  baseline  model  runs  as  discussed  in  following 
subsection  8.5. 
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TABLE  22  SUMMARY  OF  F-CLOCK  VALUES  TRANSFORMED 
FOR  KC-135A  LOOM  METRICS  VALIDATION  EXPERIMENTS 


F-CLOCKS 

F-CLOCKS 

CORING 

LORING 

BASELINE 

METRICS 

F-CLOCKS  F-CLOCKS  F-CLOCKS 

SEYMOUR-J  SEYMOOR-J  CASTLE 


F-CLOCKS 

CASTLE 

METRICS 


Fire  Detect 
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FIGURE  21  MAINTENANCE  METRICS  VALIDATION  EXPERIMENT  PROCEDURE 


INITIAL  SERIES— ASD/MCDONNELL  DOUGLAS  LOOM  SIMULATION 
OF  F-I5A/BITBURG  (1977  DATA  BASE) 


SERIES  1  BASELINE  RUN  (1977  DATA,  20  HR.  FLYING  PROGRAM) 
F-CLOCKS  BASED  ON  1977  HISTORICAL  FAILURES/SORTIE. 


SERIES  1  VALIDATION  EXPERIMENTS.  F-CLOCKS  OF  NETWORKS  TESTED 

ARE  BASED  ON  METRICS  MODELS  WITH  1977  BITBURG  OPERATING  POINT. 

'EXPERIMENT  1:  ALL  AVIONICS  AND  PROPULSION  NETWORKS  TESTED. 


( _ EXPERIMENT  2:  LARGE  DIFFERENCE  (METRICS  TO  BASELINE 

F-CLOCK  VALUES)  NETWORKS  TESTED. 

‘EXPERIMENT  3:  ENGINE  NETWORKS  #1  AND  #2  tested. 


EXPERIMENT  4:  ALL  AVIONICS  NETWORKS  TESTED. 

1  ^EXPERIMENT  5:  ENGINE  #1  NETWORK  METRIC  TESTED  SINGLY. 


EXPERIMENT  6: 
‘EXPERIMENT  7: 


FLIGHT  INDICATOR  F-CLOCK  METRIC  TESTED. 
UHF  SET  F-CLOCK  METRIC  TESTED. 


EXPERIMENT  8:  ATTITUDE-HEADING  REF.  SET  F-CLOCK 
METRIC  TESTED. 

‘EXPERIMENT  9:  INERTIAL  NAV  SET  F-CLOCK  METRIC  TESTED. 

‘EXPERIMENT  10:  AIR  DATA  SYSTEM  F-CLOCK  METRIC  TESTED. 

‘EXPERIMENT  11:  HORIZONTAL  SITUATION  INDIC.  F-CLOCK 
METRIC  TESTED. 


‘EXPERIMENT  12 

‘EXPERIMENT  13 

‘EXPERIMENT  14 
TESTED. 


AUTOPILOT  F-CLOCK  METRIC  TESTED. 
TACAN  SET  F-CLOCK  METRIC  TESTED. 
IFF  TRANSPONDER  SET  F-CLOCK  METRIC 


FIGURE  22  TASK  VIII  -  INITIAL  VALIDATION 
EXPERIMENTS  SIMULATION  PUN 
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Three  subsequent  series  of  LCOM  simulation  experiments  were 
performed  to  evaluate  all  thirty  F-clock  estimation  equations  within 
the  context  of  the  KC-135A,  an  aircraft  type  (cargo-tanker)  and  sub¬ 
system  assemblage  which  was  quite  different  than  the  baseline  aircraft 
subsystem  configuration  around  which  the  equations  were  originally 
developed,  i.e.,  the  F-15A  fighter-interceptor.  Also,  the  experiments 
pertained  to  Air  Force  base  simulations  (Loring,  Seymour-Johnson,  and 
Castle)  which  were  not  included  in  the  original  study  data  base. 
Application  to  these  bases  forms  a  significant  check  on  the  applicability 
of  the  equations  to  new  basing  situations  and  gives  indication  of  the 
relevant  range  of  the  derived  F-clock  estimation  models.  Figure  23 
presents  the  simulation  plan  for  the  KC-135A/Loring  experimental  series. 
The  Seymour-Johnson  and  Castle  simulation  plans  were  identical  to  the 
one  shown. 


As  in  the  initial  series  of  experiments,  the  objective  of 
these  simulations  was  to  determine  the  expected  accuracy  and  confidence 
level  to  be  placed  on  estimates  computed  from  the  new  metrics  models 
when  used  in  a  new  situation  or  for  an  emerging  weapon  system.  The 
validation  experiments  were  planned  to  exercise  the  KC-135A/Loring, 
Seymour-Johnson,  and  Castle  LCOM  simulations  with  the  new  F-clock  values 
to  test  the  sensitivity  of  the  simulation  results  to  the  metrics  inputs. 
The  results  of  these  simulations  were  then  compared  to  baseline  model 
rurs  and  to  actual  historical  1977  performance  data  from  the  subject 
bases  as  discussed  in  subsection  8.5.  As  depicted  in  Figure  23,  three 
simulation  runs,  each  using  a  different  clock  control  random  number 
seed,  were  executed  for  each  set  of  standard,  baseline,  and  metrics 
validation  runs.  The  code  names  of  these  runs  are  shown  on  the  simula¬ 
tion  plan.  The  three  runs  for  each  set  were  necessary  to  average  out 
random  deviations  in  the  simulation  outputs  and  allow  a  more  accurate 
comparison  of  results.  The  depicted  plan  was  meant  to  be  progressive 
depending  upon  the  results  obtained  from  the  initial  experiments  in  the 
series.  For  instance,  if  the  results  of  experiment  1  (refer  to  Figure 
23),  where  all  30  F-clocks  are  modified  and  tested  together,  indicate 
no  significant  deviations  from  the  historic  performance  data  to  be  used 
for  comparison,  further  experimentation  would  not  be  required.  If,’ 
however,  significant  deviation  was  detected,  then  further  experimentation 
according  to  the  plan  would  be  required  to  identify  the  particular  F- 
clocks  causing  the  deviation.  The  actual  results  of  experiment  1  far 
all  three  base  simulations  showed  low  deviations  so  in  all  three  cases 
the  optional  experiments  were  not  executed.  • 

Reference ^^conta ins  detailed  descriptions  of  the  execution 
and  results  of  the  various  experimental  series.  Summary  results  are 
presented  in  subsection  8.5. 
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MODEL  USED— ASD  STANDARD  LOOM  SIMULATION  OF  KC-135A/LORING  AFB 
SEYMOUR  JOHNSON  AFB/CASTLE  AFB  (1977  DATA  BASE) 


_ _ SERIES  2  COMPARISON  RUNS 

STANDARD  RUNS-  LORING  AFB  (1977  DATA,  7,481  HR.  FLYING  PROGRAM) 
F-CLOCKS  SET  AT  STANDARD  KC-135A  VALUES.  (LSEED1,  LSEED2,  LSEED3) 
BASELINE  RUNS-  F-CLOCKS  SET  AT  LORING  BASELINE  VALUES. 

(LSEED7,  LSEED8,  LSEED9) 

'SERIES  2  VALIDATION  EXPERIMENTS.  KC-135A/LORING  AFB  1977 

OPERATING  POINT.  F-CLOCKS  OF  NETWORKS  TESTED  OBTAINED  FROM 
METRICS  MODELS. 


'EXPERIMENT  1:  ALL  30  STUDY  NETWORKS  TESTED. 

(LSEED4,  LSEED5,  LSEED6) 


OPTIONAL 

FOLLOW-ON 

EXPERIMENTS 


^EXPERIMENT  2:  LARGE  DIFFERENCE  (METRICS  TO  STANDARD 
F-CLOCK  VALUES)  NETWORKS  TESTED. 


‘EXPERIMENT  3:  AVIONICS  NETWORKS  TESTED. 


‘EXPERIMENT  4:  PROPULSION  NETWORKS  TESTED. 


'EXPERIMENT  5: 


EXPERIMENT  6: 


EXPERIMENT  7: 


AIRFRAME  NETWORKS  TESTED. 

FLIGHT  CONTROL  SYSTEMS  NETWORKS  TESTED. 
UTILITY  SYSTEMS  NETWORKS  TESTED. 


FIGURE  23  TASK  VIII  -  KC-135A/L0RING  AFB 
VALIDATION  EXPERIMENTS  SIMULATION  PLAN 
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3.5  DIFFERENCE  ANALYSIS  -  BASELINE  VERSUS  MODIFIED  MODEL 

RESULTS  (NEB  METRICS)  '-"tUBTASk  33 


As  the  series  of  validation  experiments  were  performed, 
difference  analyses  were  performed  which  compared  the  results  of  the 
baseline  simulations  of  the  subject  bases  with  the  various  experimental 
runs.  In  the  case  of  the  KC-135A  runs,  these  simulation  results  were 
also  compared  with  actual  historical  squadron  performance  data  from  the 
1977  time  period  simulated.  These  analyses  indicated  how  well  the  F- 
clock  values  based  on  estimated  metrics  data  could  simulate  the  actual 
historic  situation  as  compared  to  the  current  standard  F-clock  values 
used  in  the  baseline  simulations.  The  analyses  compared  critical 
output  variables  of  the  baseline  runs  against  the  same  outputs  of  the 
various  experimental  runs.  Table  23  lists  the  twenty-five  critical 
output  variables  monitored. 

At  the  conclusion  of  the  initial  Phase  I  validation  experi¬ 
ments,  a  difference  analysis  was  performed  which  compared  the  results 
of  the  baseline  simulation  with  the  various  experimental  runs  as  listed 
in  Figure  22.  This  analysis  determined  how  well  the  F-clock  values 
based  on  estimated  data  could  duplicate  simulation  results  from  F-clock 
values  based  on  actual  historical  data. 

In  the  initial  series  of  Phase  I  validation  runs,  it  was 
found  that  the  new  F-clock  estimating  equations  developed  for  the  eleven 
avionic  systems  were  able  to  duplicate  actual  historical  results  within 
approximately  plus  or  minus  10  percent.  It  is  therefore  considered  that 
these  estimators  can  be  used  for  predicting  F-clock  values  in  new 
situations  with  a  high  degree  of  confidence. 

The  F-clock  estimating  equation  for  the  propulsion  system 
yielded  significant  deviations  in  simulation  results  compared  to  the 
baseline  run.  Therefore,  it  was  considered  that  this  estimating 
equation  required  modification  and/or  refinement  before  it  can  be  used 
with  confidence. 

As  the  series  of  KC-135A  validation  experiments  were  performed, 
difference  analyses  were  performed  which  compared  the  results  of  the 
baseline  simulations  of  the  three  subject  bases,  Loring,  Seymour-Johnson , 
and  Castle  with  the  various  experimental  runs  as  depicted  in  Figure  23. 
These  simulation  results  were  also  compared  with  actual _ historical 
squadron  performance  data  from  the  1977  time  period  simulated.  These 
analyses  indicated  how  well  the  F-clock  values  based  on  estimated  metrics 
data  could  simulate  the  actual  historic  situation  as  compared  to  the 
current  standard  F-clock  values  used  in  the  baseline  simulations.  The 
analyses  compared  the  critical  output  variables  (see  Table  23)  of  the 
baseline  runs  against  the  same  outputs  of  the  various  experimental  and 
standard  runs.  Selected  operational  and  maintenance  ( 0&M)  critical 
output  variables  from  the  baseline  runs  were  then  compared  against 
actualy  1977  values  from  the  historic  data  files  from  the  subject  bases 
in  the  G033B  and  D056E  Air  Force  data  systems.  Figure  24  depicts  the 
relationships  of  the  comparisons  made.  Summary  findings  of  these  differ¬ 
ence  analyses  are  presented  in  Table  24. 
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TABLE  23 

CRITICAL  OUTPUT  VARIABLES  MONITORED 
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FIGURE  24  RELATIONSHIPS  AND  PROCEDURE  FOR  KC-135A 
METRICS  VALIDATION  COMPARATIVE  ANALYSIS 


TABLE  24 


SUMMARY  FINDINGS  FOR  KC-135A  METRICS  VALIDATION  EXPERIMENTS 

Average  percent  difference  of  the  25 
selected  critical  output  variables  from 
1977  baseline  simulated  values  was  — 


Using  ASD  Std  Using  Maint.  Metrics 

Failure  Clocks  Derived  Failure  Clocks 


Loring  AFB:  -  2.39% 
Seymour- Johnson  AFB:  -  8.26% 
Castle  AFB:  +1.02% 


2.85% 

8.93% 

2.79% 


Seven  critical  )  and  M  performance  parameters  were  selected 
for  comparison,  i.e.  — 

o  Flying  Hours  Per  Aircraft  Per  Year 
o  Sorties  Per  Aircraft  Per  Year 
o  Average  Operational  Ready  Rate 
o  Average  Not-Operationally-Ready-Maintenance  Rate 
o  Average  Not-Operational ly-Ready-Supply  Rate 
o  Total  Maintenance  Manhours  Per  Aircraft  Per  Year 
o  Average  Maintenance  Manhours  Per  Flying  Hour 

The  average  percent  deviation  of  these  parameters  as  simulated  by  the 
baseline  series  runs  of  the  KC-135A  LCOM  were  as  follows: 

■Loring  AFB:  -  7.45%  average  deviation 

Seymor-Johnson  AFB:  -  9.57% 

Castle  AFB:  -  14.08% 

The  comparative  analyses  of  the  outputs  of  the  standard  and 
metrics  simulation  runs  against  the  baseline  runs  checked  the  success 
of  the  new  metrics  in  simulating  base-specific  situations.  The  overall 
findings  of  these  analyses  indicated  that  the  newly  developed  mainte¬ 
nance  metrics  were  approximately  equal  to  the  ASD  developed  standard 
KC-135A  metrics  in  producing  simulation  results  similar  to  the  base- 
specific  metrics  used  in  the  baseline  runs.  Both  types  produced 
simulated  outputs  that  were  generally  within  3%  of  the  baseline  outputs 
for  Loring  and  Castle  AFB's,  and  within  9%  for  Seymour-Johnson  AFB. 
These  deviations  were  considered  well  within  the  range  of  acceptability 
for  most  applications  of  the  KC-135A  LCOM  simulation. 
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The  comparisons  of  the  outputs  of  the  baseline  simulation 
runs  with  actual  1977  O&M  histories  at  the  subject  bases  measured  the 
overall  fidelity  of  the  KC-135A  LCOM  with  the  ASD  standard  input  module 
(except  for  F-clock  values)  in  reproducing  actual  base  conditions. 

These  comparisons  indicated  acceptable  levels  of  deviation  between  the 
LCOM  outputs  and  actual  1977  field  data.  The  average  deviations  of  the 
selected  O&M  parameters  were  under  10%  for  Loring  and  Seymour-Oohnson 
AFB's,  and  under  15%  for  Castle  AFB  (see  Table  14). 

Since  the  results  of  the  Validation  Experiment  1  runs  as 
discussed  above  showed  such  low  deviations,  the  optional  follow-on 
experiments  shown  on  the  validation  plan  of  Figure  23  were  not  performed. 

Reference^^  contains  complete  detailed  discussions  and 
data  of  the  results  of  the  various  difference  analyses. 
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9.0  SUMMARY  CONCLUSION 


9.1  SYNOPSIS 


This  report  is  the  final  in  a  series  of  five  technical 
reports  which  document  the  results  of  an  eight  task  study  to  develop 
new  maintenance  metrics  to  aid  in  forecasting  the  resource  damands 
of  weapon  systems.  It  presents  descriptions  of  methodologies  and 
findings  recommended  for  application  to  the  readiness  analysis  and 
resource  loading  of  emerging  Air  Force  weapon  systems  and  basing 
concepts.  Recommended  methodologies  and  findings  contained  within 
this  final  report  include:  1)  Review  of  Published  Literature; 

2)  Critical  Equipment  Selection;  3)  Maintenance  Impact  Parameter 
Identification;  4)  Data  BAse  Assembly  and  Integration;  5)  Mainte¬ 
nance  Impact  Estimating  Relationship  Detection  and  Analysis;  6} 
Maintenance  Metric  Model  Development;  and  7)  Maintenance  Metrics 
Validation.  The  methodologies  and  findings  contained  within  this 
final  report  are  presented  in  logical  functional/sequential  flow 
formats  and  represent  the  results  of  the  research  approaches  and 
“lessons  learned"  during  the  implementation  and  completion  of  this 
AFHRL  study  effort. 

9.2  PROBLEMS,  ASSUMPTIONS,  AND  UNCERTAINTIES 

Only  one  significant  problem  was  encountered  during  the 
study.  This  was  the  inevitable  problem  of  long  lead  times  between 
request  and  receipt  of  certain  types  of  data  such  as  Air  Force 
weather  summaries.  This  problem  was  anticipated,  however,  and  the 
study  work  schedule  designed  to  accommodate  possible  data  delays. 

These  workarounds  were  successfuLand  all  intended  work  was  accom¬ 
plished  on  schedule.  Reference (^contains  a  detailed  discussion  of 
this  problem. 

Certain  assumptions  and  uncertainties  were  inherent  in 
the  regression  procedures  used  to  develop  the  maintenance  metrics 
models.  These  were: 

(1)  The  assembled  data  were  accurate  and  unbiased. 

(2)  Each  data  case  value  was  a  member  of  a  continuous 
normal  distribution  of  possible  values  for  that  data  case  (a  necessary 
condition  for  least  squares  regression). 

(3)  Each  major  independent  variable  appearing  in  each 
metrics  model  equation  is  unrelated  to  the  other  major  independent 
variables  in  the  model. 

(4)  The  range  of  values  represented  by  the  nine  case 
data  samples  used  encompassed  essentially  the  full  range  of  possible 
Air  Force-wide  values  for  equipment,  operational,  and  environmental 
characteristics. 
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The  last  assumption  deals  with  sufficiency  of  data.  This 
uncertainty  is  present  in  every  statistical  analysis.  A  minimum  of 
thirty  cases  is  preferred  for  high  confidence  in  unbiased  results. 
However,  the  rather  sparse  nine  case  sample  used  in  this  study  should 
still  produce  estimation  and  prediction  results  which  improve  on  present 
methods  of  predicting  the  maintenance  demands  of  new  weapon  systems 
and/or  basing  concepts.  Referenceijf)  contains  a  detailed  discussion 
of  the  above  assumptions  and  data  rainge  uncertainty. 

9.3  RECOMMENDATIONS 


The  following  recommendations  are  provided  as  a  guide  to 
application  and  follow-on  studies  using  the  developed  methodologies. 

(1)  The  data  base  assembled  during  study  tasks  one  through 
four  contains  a  wealth  of  organized  data  that  will  be  useful  for  logistic, 
operations,  and  environmental  analyses  for  aircraft.  The  data  are  also 
useful  for  comparability  analyses  of  emerging  weapon  systems. 

(2)  The  maintenance  impact  estimating  relationships 
developed  in  task  five  are  irmiediately  applicable  to  the  identification 
and  quantification  of  the  design,  operational,  environmental,  and 
maintenance  factors  which  impact  the  maintenance  of  aircraft  equipment. 

(3)  The  maintenance  metrics  estimating  models  developed 

in  tasks  six  and  seven  are  easy  to  use  and  are  in  a  form  that  facilitates 
immediate  application  to  maintenance  resource  predictions  for  new 
aircraft  equipment,  new  bases  for  existing  aircraft,  new  operational 
scenarios,  and  LCOM  simulation  studies. 

(4)  In  addition,  the  developed  metrics  will  be  useful  in 
Air  Force  manpower  determination  studies,  cost  of  ownership  studies, 
design  trade  studies  for  future  aircraft,  and  readiness  determination 
studies. 
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GLOSSARY  OF  ABBREVIATIONS 


AB 

Air  Base 

ACFT 

Aircraft 

AFB 

Air  Force  Base 

AFHRL 

Air  Force  Human  Resources  Laboratory 

AFMEA 

Air  Force  Management  Engineering  Agency 

AGE 

Aerospace  Ground  Equipment 

AMS 

Avionics  Maintenance  Squadron 

AVG 

Average 

BIT 

Built  In  Test 

BMW 

Bomb  Wing 

CU 

Cubic 

EAC 

Experience  Analysis  Center 

EMAD 

Estimate  of  Maintenance  Action  Demand 

ENVIRON 

Environment 

EQUIP 

Equipment 

F-CLOCK 

Failure  Clock 

FOD 

Foreign  Objects  Damage 

FT 

Feet 

FTW 

Fighter  Training  Wing 

HF 

High  Frequency 

HR 

Hour 

HRS 

Hours 

IFF 

Identify  Friend  or  Foe 

I/O 

Input/Output 
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LB's 

LCQM 

MAC 

MAINT 

MAW 

MH 

MIER 

MIN 

MMH 

MMM 

MO 

MRD 

NO 

NORM 

NORS 

OCALC 

OPNL 

OR 

ORG 

O&S 

SAALC 

SAC 

SPSS 

SRU 


Pounds 

Logistic  Composite  Model 
Military  Airlift  Command 
Maintenance 
Military  Airlift  Wing 
Manhour 

Maintenance  Impact  Estimating  Relationship 
Minute 

Maintenance  Manhour 
Maintenance  Manpower  Model 
Month 

Maintenance  Resource  Demand 
Number 

Not  Operational  Ready  Maintenance 

Not  Operational  Ready  Supply 

Oklahoma  City  Air  Logistics  Center 

Operational 

Operational  Ready 

Organization 

Operations  and  Support 

San  Antonio  Air  Logistics  Center 

Strategic  Air  Command 

Statistical  Package  for  the  Social  Sciences 
Shop  Removable  Unit 
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TAC  Tactical  Air  Command 

TACAN  Tactical  Air  Navigation 

TFW  Tactical  Fighter  Wing 

TO  Technical  Order 

TR  Technical  Report 

TTW  Tactical  Training  Wing 

UHF  Ultra  High  Frequency 

USAFE  United  States  Air  Forces  Europe 

WUC  Work  Unit  Code 

WT  Weight 
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APPENDIX  A 


METRICS  CATALOG  DATA  ENTRY  FORM 
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METRICS  CATALOG  DATA  ENTRY  FORM 


The  following  enumerates  the  title,  contents,  and 
purpose  of  the  field  as  shown  in  Figure  A-l.  Since  the 
alpha  character  preceeding  each  field  is  only  used  by  the 
computer  for  identification  of  that  field,  it  will  not  be 
included  with  the  title. 

DOC  -  This  is  the  sequential  accession  number 

assigned  by  EAC  investigators  for  tracking  and 
retrieval  purposes. 

TITLE  -  Document  title. 

PERSONAL  AUTHOR  -  Originator  of  the  document. 

DOC  NO.  -  Document  number. 

FORM  -  The  actual  physical  form  of  the  document,  i.e., 
hard  copy,  magazine,  microfiche,  etc. 

SOURCE  -  The  name  of  the  company  or  government  agency 
from  whom  the  document  was  obtained  or  ordered 
from. 
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FIGURE  A-l  METRICS  CATALOG  DATA  ENTRY  FORM 


D1 94-1 0089-5 


TYPE  OF  DATA  -  Seven  major  areas,  each  with  several  sub- 


areas,  are  identified  to  categorize  the 
contents  of  each  document. 

PHASE  -  That  particular  phase  of  life  the  contents  of 
the  document  covers. 

NUMBER  REPORTS  -  Applicable  to  listings/indexes  as  to 

the  number  of  documents  contained  therein. 

ORDER  DATE  -  The  date  a  document  was  ordered  from  the 
source. 


RECEIVED  DATE  PSEUDO  -  A  fictitious  date  utilized  by  the 

computer  to  indicate  all  documents 
ordered  but  not  received. 

FILED  -  An  internal  study  requirement  to  specify  the 
location  of  a  document. 

QUALITY  OF  DATA  -  An  internal  study  requirement  to 

distinguish  between  listings/indexes/ 
bibliographies,  reviewed  documents, 
and  whether  the  information  was  of  use 
to  this  study. 
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ADDRESS  -  Source  address. 


PUBLISHED 

ABSTRACT  - 


-  Document  publish  date. 

If  the  contents  of  a  document  reviewed  did 
not  contribute  to  any  area  within  the  study, 
an  abstract  was  written  for  informational 
purposes. 
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To: 


Subject: 


Headquarters  Strategic  Air  Command 
Attn:  LGM 

Offutt  Air  Force  Base,  Nebraska  68113 


25  April  1978 
In  Reply  Refer  To 
2-3552-0078-032 


Air  Force  Contract  F33615-77-C-0075,  "Development  of  Maintenance 
Metrics  to  Forecast  Resource  Demands  on  Weapon  Systems"  (METRICS) 


Contract  Monitor: 
Mr.  Frank  Maher 
AFHRL/ASR 
WPAFB,  Ohio  45433 
PH  (513)255-3771 


Contract  Manager: 

Mr.  George  R.  Herrold 
Boeing  Aerospace  Co. 

M/S  4A-45 ,  P.0.  Box  3999 
Seattle,  Washington  9812' 
PH  (206)655-1941 


INTRODUCTION:  The  Boeing  Aerospace  Company  is  performing  a  study  for  the  Air  Force 
to  develop  maintenance  metrics  to  forecast  resource  demands  of  operational  and 
new  development  aircraft. 


OBJECTIVE:  This  research  is  designed  to  determine  hew  hardware ,  operational ,  and 
envi ronmental  parameters  impact  maintenance  demands  on  aircratt^  More  accurate 
METRICS  (hardware  [measures]  and  operational  and  environmental  [weightings])  will 
be  developed  for  Incorporation  into  the  Air  Force  method  (Logistics  Composite 
Model  [LCGM])  of  determining  maintenance  resource  demands. 


ASSISTANCE  REQUIRED:  In  compliance  with  the  subject  contract,  authorization  is 
requested  to  visit  the  maintenance  organization  of  the  following  bases  to 
obtain  applicable  aircraft  operational  and  maintenance  type  data.  Specific 
data  categories  and  elements  will  be  coordinated  with  the  various  points  of 
contact  prior  to  visit. 

DESIRED  DATE 

BASE  (LENGTH  OF  VISIT) 

Fairchild  AFB  (B-52/KC-135  Wing)  June  26,  1978  (2  days) 

Plattsburgh  AFB  (FB-111  Wing)  June  29,  1978  (2  days) 


Dr.  Gordon  A.  Eckstrand 

Director:  Advanced  System  Division  (AFHRL/AS) 
Air  Force  Human  Resources  Laboratory 
Wright-Patterson  AFB,  Ohio 
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Georgp'R.  Herrold 
Contract  Manager 
Boeing  Aerospace  Co. 
Seattle,  Washington 


1 


APPENDIX  C 


BASE  VISIT  -  DATA  ACQUISITION 
QUESTIONNAIRE 


EXAMPLE 
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METRICS  I  AVIONICS  -  EXAMPLE  QUESTIONNAIRE  FORM 

WUC'S  -  ,  or 

NOTE:  The  complete  avionics  questionnaire  form  contained  25 

equipment  related  questions  Reference  /^2\  Boeing  Interim 

Technical  Report  D1 94-10089-1  contains  a  complete  set  of 

the  questionnaire  forms  utilized  in  the  study. 


1.  NATIONAL  STOCK  NUMBER  AND/OR  PART  NUMBER?  (QUICK  REFERENCE  LIST?  YES  OR  NO) 


2.  LOCATION  OF  EQUIPMENT  ON  AIRCRAFT? 


3.  NUMBER  OF  EQUIPMENT  (QPA)  IN  AIRCRAFT? 


4.  EQUIPMENT  WEIGHT? 
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APPENDIX  D 

GENERIC  MAINTENANCE  METRICS  MODELS 


TABLE  D1  EQUIPMENT  CHARACTERISTICS 
MAINTENANCE  METRICS  MODELS 

TABLE  D2  OPERATIONAL  CHARACTERISTICS 
MAINTENANCE  METRICS  MODELS 

TABLE  D3  ENVIRONMENTAL  CHARACTERISTICS 
MAINTENANCE  METRICS  MODELS 

TABLE  DA  DEFINITION  OF  GENERIC  MODELS' 
PARAMETERS 
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TABLE  D1  EQUIPMENT  CHARACTERISTICS  MAINTENANCE  .METRICS  MODELS 


MAD  PER  UE  PER  YEAR  -  F(  EQUIPMENT  PARAMETERS  ) 


PROPULSION  SYSTEM 
MAD 

-  -44 . 142+0 . 421 (P02) +0 . 192 (PQ4) 

FLIGHT  INDICATORS 
iMAD 

-  -0.557-KD.720CA0J> 

AIR  DATA  SYSTEM 

MAD 

“  +8. 271+0. 155 ( A03) -1.680  CAO 7) -0 . 298 ( A16) -0 . 054 (A19) 

HSI  SET 

MAD. 

-+4.643-1.076  CA07)  -0 . 296  (A16)  +0 . 0065  (AJ8) 

AUTOPILOT 

.MAD 

*  +39 . 196-1 . 163CA03) +0 . 032 (A04) -2 . 885 (A08) 

-3 . 698  CA13) -0 . 262 (A19) 

UHF  COMM  SET 
.MAD 

=>  -3 . 131+3 . 418  (A03)  -0 . 081  ( A04)  -1 . 562  CA05) 

IFF  TRANSPONDER 
MAD 

-  +1. 147+0. 377(A02)-0.0185(A09) 

INS  SET 

MAD 

-  -0. 034+0. 546(A05) 

ILS  SET 

MAD 

=  -0 . 456+0 . 200 (AQ2) +0 , Oil CA06)+0 . 043 (A15) 

TACAN  SET 

MAD 

-  +0 . 366+9 , 17 9 ( A03) -0.159 (A18) 

A-H  REF  SET  ' 

MAD 

■  +6 . 371-1 . 022 (A08) -0 , 074  CA12) 

RADAR  SET 

MAD 

■  -139 . 80-5 . 896(A02)+O ,211(A12)+1 . 837(A19> 
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TABLE  D1  CONTINUED 


RADOME 

MAD 

=  -0. 16+0. 2988(F08) 

WINDSHIELD 

MAD 

=  +73. 211+0. 0069(F03)-0. 7321 (F07) 

WINGS 

MAD 

=  -2. 8658+0. 0263(F04) 

SEATS 

MAD 

=  -0. 4209+0. 008(F11) 

MAIN  LANDING  GEAR 
MAD 

=  -0. 834+0. 002(F03)+1.126(F06)+ 

+4. 505 (FI  3) -0.021 (F22) 

BRAKES 

MAD 

=  +6. 6688-0. 0598(F09) 

STABILATOR 

MAD 

■  -4. 7109+0. 0032(F03)+0.9834(F06) 

RUDDER 

MAD 

=  None 

FLAPS 

MAD 

=  - 1 0 . 1 007+0 . 0099 ( F03 ) -0 . 0082 ( F04 ) 
+2.2542(F06)-0.2792(F08)+2.6026(F10) 

WATER  SEPARATOR 

MAD 

=  -0.0517+0. 1196(F08) 

GENERATOR  ASSY 

MAD 

=  +0.1755  +1 . 0992 ( FI  3 ) 

(SHEET  2) 
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TABLE  D1  CONTINUED 


ANTI-COLLISION  LIGHTS 

MAD  =  +1.1342+0. 2321 (F03)-0.4572(F06) 


LANDING/TAXI  LIGHTS 

MAD  =  -1. 4892+0. 21 1 2 ( F03)+32 . 81 96 ( FI  3 ) 


HYDRAULIC  PUMPS  »  +0. 8148+0. 0009(F04)-0. 0630(F11 ) 
MAD 


FUEL  TANKS  =  -1.71 68+0 . 6864( FI  6) 

MAD 


OXYGEN  REGULATOR  =  +1 . 4902-0 . 451 9 ( F03 ) 
MAD 


LOX  CONVERTER  =  -0.336+0.1 324 (F08) 
MAD 


ENGINE  FIRE  DETECTION 

MAD  =  +0.0686-0. 0322 (F04)+0. 0093 (F08) 


(SHEET  3) 
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TABLE  02  OPERATIONAL  CHARACTERISTICS  MAINTENANCE  METRICS  MODELS 


MAD  PER  UE  PER  YEAR  =  F(  OPERATIONAL  PARAMETERS  ) 


PROPULSION  SYSTEM 
MAD 

-  -73 , 317+0 . 034 (010) -1 . O13(014)+O . 303(027) 

+11 ,756(032)+25 .771 (0335 

FLIGHT  INDICATORS 
HAD 

3  -17 .267+0 . 003(011) +0 . 002 ( 013) +0 . 0086 ( 017) 

+0.020(025) 

AIR  DATA  SYSTEM 

MAD 

=  +4 . 628-0 . 0017 (008) +0 . 0013 (013) -0 . 312 ( 023) 

HSI  SET 

MAD 

-  +1.378+0. 036 (014) -0.615 (033) 

AUTOPILOT 

MAD 

=  +7 .294-0 . 0015 ( 008) +0 , 388 ( 023) 

UHF  COMM  SET 

MAD 

=  +10. 022-0. OO2(0O8)+O. 910(013) 

IFF  TRANSPONDER 
MAD 

-  +14 . 439+0 , 260 ( 005) -0 . 017 (009 ) -0 . 119 ( 012) -0 . 706 ( 030) 

INS  SET 

MAD 

*  -10.681+0,004(013) 

ILS  SET 

MAD 

*  -0.035+0. 0024(015) -0 . 0044(02 7) -0 . 0025 (032) 

TACAN  SET 

MAD 

-  -2. 056+0 '.0074 (015) +0. 425(032) 

A-H  REF  SET 
jMAD 

*  -13,778+0,112(005) 

RADAR  SET 

MAD 

*  +12. 669+0. 006 (010) -0,0045 (011) 

(SHEET  1) 
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TABLE  D2  CONTINUED 


RADOME 

MAD 

•  -10.099+0. 104 (005) -0.051  (01 2) +0.0062 (021 ) 
+0.0046(025) 

WINDSHIELDS 

MAD 

=  +2. 6135-0. OO56(015)+O.O4OO{021)-O. 0463(027) 

WINGS 

MAD 

=  +94.2723+0.2681 (0O2)-O.O113(0O8)+O. 0078(010) 

-0. 4550 (01 2 )-0. 1245 (01 4) -0.0382 (01 7) +0.1 199(021 ) 

SEATS 

MAD 

=  -2. 0778+0. OOO5(0O8)+0. 01 29(012)+0. 0032(017) 
+0.0168(021 )-O.OO43(025)-O. 0307(027) 

MAIN  LANDING 
GEAR 

MAD 

=  -5. 1619+0. 0021 (01O)+2.24O7(014)-O. 0211 (015) 

+0. 0343(016)+O.O218(019)+0. 0368(021  )-4. 6455(032) 

BRAKES 

MAD 

=  - 1 2 . 007+2 . 1 964  (0O3)+0 . 077  (005 )  +0 . 0059  ( 009 ) 

+0.0046 (01 6) -0.0023 (020) +0.01 38(026) -0.001 (031 ) 

STABILATOR 

MAD 

=  +1 .5652+0.0361 (021 )-0. 0447(027) 

RUDDER 

MAD 

*  -0. 4337+0. OO39(015)-O.OO15(017)-O. 6222(034) 

FLAPS 

MAD 

=  +13. 1908-0. O313(015)+O. 1853(021 )-0. 2099(027) 

WATER  SEPARATOR  M  „ 

MAD  None 

GENERATOR 

ASSY 

MAD 

=  -1. 7639+0. O23(0O7)+O. 0817(032) 

(SHEET  2) 
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TABLE  02  CONTINUED 


ANTI-COLLISION  = 
LIGHTS 

MAD 

+9. 3845-0. 0022(01 l)+0. 0079(021) -0.0061 (025) 
-0.0201 (027) 

LANDING/TAXI 

LIGHTS 

-  MAD _ 

=  +3. 3516-0.0071 (015)+O. 0522(021 )-O597(027) 

HYDRAULIC  PUMPS 
MAD 

=  -1 .7478+0. O167(0O5)+O. 0001 (0O6)-O. 0002(008) 
+0. 0021 (01 4) -0 . 1 828(032 )+0 . 171 5(033) 

FUEL  TANKS 

MAD 

=  +7. 81 02+0. 001 4 (010) -0.001 2 (011 ) -0.01 72(015) 
+0. 0145(01 7)+0. 0311 (021 )-0. 0646(027) 

OXYGEN  REGULATOR 
MAD 

=  -0.0196+0.3685(030) 

LOX  CONVERTER 

MAD 

=  -2. 041+0. O147(0O5)-O. 0001 (0O6)+O. 282(033) 

ENGINE  FIRE 
DETECTION 

MAD 

=  None 

(SHEET  3) 
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TABLE  D3  ENVIRONMENTAL  CHARACTERISTICS  MAINTENANCE  METRICS  MODELS 
MAD  PER  UE  PER  YEAR  -  F(  ENVIRONMENTAL  PARAMETERS  ) 


PROPULSION  SYSTEM  -  *99.239-1. 883<E13) 
MAD 


FLIGHT  INDICATORS  -  -7.598-0.008(EQ3)+0  104(E19) 
MAD 


AIR  DATA  SYSTEM  -  -7.571-0. 132<E13)+0.146(E19)-0.071(E20> 
iMAD 


HSI  SET  -  -5 , 866-0 . 074 ( E13)  +0 . 039 (E18) +0 , 097 ( E20) 

MAD. 


AUTOPILOT  »  +12. 681+0. 474 (EOS)-O. 057 (E18) 

MAD 


IJHF  COMM  SET  -  -2.359-0.258(E13)-0.089(E18)+0.1I8(E19) 
MAD  -0 . 039 (E27) +7 . 457CE30) 


IFF  TRANSPONDER  *  +2 . 930+0 . 012 (E06) -0 . 0535 (E09) +0 . 0042 (E31) 
MAD 


INS  SET  -  -2. 203+2. 447 (E21) 

MAD 


ILS  SET  -  -0.031+0. 025 (E20) 

MAD 


TACAN  SET  -  +0. 875+0. 007(E03)-0. 022 (E09) 

MAD  •  -0,Q596(E13)+0.163(E20) 


A-H  REF  SET  -  +1.093+0. 0255 (E27) 
MAD 


RADAR  SET  *  -17. 455-0. 233(E13)+0.042(E16) 

MAD  +Q.083(E18)+G.284(E2Q) 


(SHEET  1) 
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TABLE  D3  CONTINUED 


RADOME  =  +5. 81 81 -0. 0006 (E02) -0.0234 (El  8) +0.01 92(E20) 

MAD 


WINDSHIELD  =  +15. 5688-0. 0722 (El  8) 

MAD 


WINGS  =  -0. 5229-0. 3386(E13)+1.032(E20) 

MAD 


SEATS  =  -3. 0919+0. 0216(E'19)+0.0462(E20) 

MAD 


GEAR  LAN°ING  =  +2.061  &+0 . 3565 ( E20 ) 
MAD 


BRAKES  =  +0. 0304-0. 0026(E03)+0.0067(E16) 

MAD 


STABILATOR  -2.8538+0. T942(E20) 

MAD 


RUDDER  *  -2. 6783-0. 0023 (E03)-0.0038(E09) +0.01 36 (El 8) 

MAD  +0.0614(E24} 


FLAPS  *  +18.583-0. 1954(E18)+0.2366(E19) 

MAD 


WATER  SEPARATOR  =  -1 .249+0. 022 ( ET 9 ) -0 . 01 88 ( E24 ) 
MAD 


GENERATOR  ASSY  =  +0.669-0.0093(E13) 
MAD 


(SHEET  2) 


139 

D1 94-10089-5 


t  1 


TABLE  D3  CONTINUED 


ANTI-COLLISION 

LIGHTS 

MAO  . 

=  +1 1  . 00  74  -  0.000  7 (E02)-0.00AF(EQ3) -0.0257 (El  8) 
-0.9807(E30) 

LANDING/TAXI  LIGHTS 

MAD  =  +6. 1366-0. 0654 ( El 8)+0 . 0795 ( El  9) 

HYDRAULIC  PUMPS 
MAD 

=  +0.1 558-0. 01 505(E06)+0.252(E08) 

FUEL  TANKS 

MAD 

=  +5 .03+0. 009 (El  6) -0.027 (El  8) +0.035 (El  9) 
-0.064(E23) 

OXYGEN 

REGULATOR 

MAD 

»  +6 . 41 4+0 . 0099 ( E06 ) +0 . 04 1 2 ( E07 ) -0 . 0026 ( El  6 )+ 
+0.195(E21 ) -0 . 0291 (E23)-0.0672(E24)-0.0515 
(E27) 

LOX  CONVERTER 

MAD 

=  +0. 2299+0. 0842(E08) 

ENGINE  FIRE 
DETECTION 

MAD 

-  -0. 2536+0. 0006(E16)+0.0026(E19)-0. 001 7(E24) 

(SHEET  3) 
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APPENDIX  E 


TABLE  El 

TABLE  E2 


COMPOSITE  MAINTENANCE  METRICS 
AND  WEIGHTINGS  MODELS 

DEFINITION  OF  COMPOSITE  MODELS' 
PARAMETERS 
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TABLE  HI  COMPOSITE  MAINTENANCE  METRICS  AND  WEIGHTINGS  MODELS 


PROPULSION  SYSTEM  = 

-57 . 675+0 . 244 (P02) +0 . 05  5  CP04) +0 . 02 1( 010) 

MAD 

+0 . 203 (027) -0,798 (032) +7 . 509(033) 

FLIGHT  INDICATORS  * 

-4.658+0. 398 (A03) +0 . 00004 ( 013) +0 .0016(017) 

MAD 

-0 . 0036 ( E03) +0 . 045 (E19) 

AIR  DATA  SYSTEM  = 

-  1 . 975+0 . 023 (A03) -0 . 035 (A16) -0.0008(008)' 

MAD 

+O.OOO5(013)-Q. 071(023) -0,046(E13)+0.063(E19) 

HSI  SET  - 

-14 . 292+0 . 7SKA07)  +1 . 003CA16)  -0 .049  (014) 

MAD 

+3 . 020(033) +0 . 177 (E20) 

AUTOPILOT 

+21 . 944-0 . 481 (A03) +0 . 0159 ( A04) -1 . 496 (A13) 

MAD 

-0 . 258 (A19) -0 . 0004 ( 008) +0 . 637(023) +0 . 016 ( E18) 

UHF  COMM  SET 

-101 . 62-0 . 208(AQ3)+1 . Oil (AOS) -0 . 016 (008) 

MAD 

+6 . 732 (018) +1 . 415 (E18) +0 . 419 (E19) -60 . 986 ( E30) 

IFF  TRANSPONDER  = 

+  0 . 890+0 . 602 (A02) -0 . 026 (A09) -0 . 813 ( 030) 

MAD 

+0.0078(E09) 

INS  SET 

-  0.034+0. 346 CA05) 

MAD 

ILS  SET 

-  !.  12 8+0 . 025 (AOS) +0 . 0040 ( 015) -0 . 0074 (0271 

MAD 

-0,025(E20) 

TACAN  SET  - 

-  1.843+0. 061  (A03)  -0.044  (A18)  +0 . 099  (032) 

MAD 

+0 . 0058(E03) -0 , 017 (E09) +0. 142 (E20) 

A-H  REF  SET 

-11 . 435-1 . 967 (A08) +0 . 155(005) -0 . 056 (E27) 

MAD 

RADAR  SET  '  = 

-163 . 53-7 . 695 (A02) +0 . 209 ( A12) +2 . 017 ( A19). 

MAD 

+0 . 0013 (011) +0 . 271 (E13) +0 . 138CE20) 

(SHEET  1} 
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TABLE  El  CONTINUED 


RADOME 

MAD 

=•  -2. 299+0. O58(FO8)+O.O274(0O5)+O. 0125(021) 
-0.078(E20) 

WINDSHIELD 

MAD 

=  +18. 2433-0. O99(FO7)-O.OO53(015)+O. 0309(021) 
-0.0371 (027)-O.O289(E18) 

WINGS 

MAD 

=  -27.4212+  .O2O5(FO4)-O.OO63(0O8)+O. 5034(012) 
-O.O962(014)+O. 0157(021 )-0.3339(E13)+0. 2438 
(E20) 

SEATS 

MAD 

=  -4. 6375+0. OO1O(0O8)+O.O493(012)+O. 0086(017)+ 
+0. 024(021 )-O.OlO(025)-O.O538(027)-O. 0245 
(El  9) 

MAIN  LANDING  GEAR 
MAD 

=  -3. 8152+1. 1603(F06)+1.7355(F13)+0. 0389(014) 
+0.0101 (019)+O.OO13(FO3) 

BRAKES 

MAD 

=  -31. 3801+0. 1277(F09)+2. 0431 (0O3)+0. 1902(005) 
+0. OO17(026)-O. 001 7(031 )-0.008(E03) 

STABILATOR 

MAD 

=  -2. 469+0. 0023(F03)+0.8617(F06)+0. 0141  (021)- 
-0.0872(E20) 

RUDDER 

MAD 

=  +0.2636+0.0022(015)-! . 9625 (034) *-0 . 001 3(E03) 

FLAPS 

MAD 

=  +48 . 3324+0 . 01 0 ( F03 ) +0 . 96  7 ( F06 ) -0 . 61 8 ( F08)  - 
-0 . 02  3 (01 5 ) +0 . 007 ( 02  7 ) -0 . 224 ( El  8) +0 . 049 ( El  9 ) 

WATER  SEPARATOR 
MAD 

=  -1. 249+0. 022(E1?)-0.0188(E24) 

GENERATOR  ASSY 

MAD 

=  -1. 290+0. 904(F13)+0. 018(007) 

(SHEET  2) 
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TABLE  El  CONTINUED 


ANTI-COLLISION 

LIGHTS 

HAD _ 

*  +27.614-0.1 434 (F03)+l . 070 ( F06) -0.010(011)- 
-0.019(021 )-0. O38(025)-O.O84(027)+3. 971 (E30) 

LANDING/TAXI 

LIGHTS 

MAD 

=  +4. 937+0. 280(F03)+1 8. 60(F13)-0. 006(015)- 
-0.0498(E18)+0.051 ( El  9 ) 

HYDRAULIC  PUMPS 
MAD 

*  +1 .0089-0.031 (FI  1 ) -0.0001  (0O8)-O.OO5(014)- 
-O.O26(032)+O.288(033)+O.O13(EO6)-O.O79(EO8) 

FUEL  TANKS 

MAD 

=  +12. 353+0. 080(F1 6 )+O.OOO3(01O) -0.0078(015)+ 
+0.0169(021 ) -0 . 01 9 ( 02  7 ) -0 . 060 (El 8)+0 . 027  (El  9) 

OXYGEN  REGULATOR 
MAO 

=  +5.476-0.121 (FO3)-O.356(03O)+O.O38(EO6)+ 
+0.026(E07)+0.181 (E21 ) -0.081 (E24)-0.065(E27) 

LOX  CONVERTER 

MAD 

=  - 2 . 4302+0. 05 8 ( F08 ) +0 . 0 1 6 ( 005 ) - 0 . 0001(006)+ 
+0.168(033) 

ENGINE  FIRE 
DETECTION 

MAD 

=  ~0.316-0.006(F08)+0.0006(E16)+0.004(E19)- 
-0.001 7(E24) 

(SHEET  3) 


TABLE  E2  DEFINITION  OF  COMPOSITE  MODELS'  PARAMETERS 
(SHEET  1) 


EQUIPMENT 

PARAMETERS 


OPERATIONAL 

PARAMETERS 


P02  =  TOTAL  NO.  OF  ENGINES 

P04  =  WT.  PER  ENGINE 

A02  =  EQUIP.  LOCATION  ON  AC FT. 

AO 3  =  EQUIP.  WT. 

A04  =  EQUIP.  VOL. 

A05  =  SRU  COUNT 
A06  =  OPERATING  TEMP. 

AO 7  =  COOLING  METHOD 

AO 8  =  PROTECTION  DEVICES 

A09  =  NO.  OF  TEST  POINTS 

A12  =  AGE  UNRELIABILITY 

AT 3  =  AVG.  OP.  TIME  PER  SORTIE 

A16  =  ON-OFF  CYCLES  PER  FLT.  HR. 

A18  »  GND/FLT  OPERATING  RATIO 
A19  =  FAILURE/ ABORT  RATIO 
F03  =  EQUIP.  WT. 

F04  =  EQUIP.  VOL. 

F06  =  SUPPORT  EQUIP.  COMPLEXITY 

F07  =  SUPPORT  EQUIP.  RELIABILITY 

F08  =  TYPE  OF  FAILURE  PROBLEMS 

F09  =  IN- FLT  SQUAWK  VERIFICATION  RATE 

FI  1  =  GRD  TO  FLT  OP.  RATIO 

FI 3  =  REMOVALS  TO  ACCESS  OTHER  EQUIP. 

.FI 6  =  EQUIP.  PROTECTION  METHODOLOGY 

005  »  AVG.  TAKE-OFF  SPEED 

008  =  AVG.  CLIMB  RATE 

010  =  AVG.  CRUISE  ALTITUDE 

011  =  AVG.  DESCENT  RATE 

013  =  MIN  LANDING  DISTANCE 

014  =  AVG.  LANDING  WT. 

015  =  TOTAL  FLT.  HR.  PER  ACFT. 

017  =  OPS.  FLT.  HR.  PER  ACFT. 

018  =  MISC.  FLT.  HR.  PER  ACFT. 

023  =  AVG.  NO.  ALERT  ACFT. 

027  =  OPS.  SORTIES  PER  ACFT. 

030  »  MAX  ACFT.  SPEED 

032  =  ACFT.  CREW  SIZE 

033  =  AVG.  SORTIE  LENGTH 

003  =  AVG.  MISSION  MIX 

006  =  MEDIAN  TAKE-OFF  DISTANCE 

007  »  PERCENT  OF  MAX.  TAKE-OFF  WT. 

019  =  TOTAL  LANDINGS  PER  ACFT. 

021  =  OP.  LANDINGS  PER  ACFT. 

026  =  TRAINING  SORTIE  PER  ACFT. 

031  =  SERVICE  ACFT  CEILING 

034  =  ACCIDENTS  (MAJOR/MINOR)  PER  ACFT. 

012  =  AVG.  LANDING  SPEED 

025  =  TOTAL  SORTIES  PER  AIRCRAFT 
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TABLE  E2  CONTINUED 
(SHEET  2) 


ENVIRONMENTAL 

PARAMETERS 


E03  =  RUNWAY  DIRECTION 

E09  =  NO.  RAIN  DAYS 

El  3  =  NO.  THUNDER  DAYS 

El 8  =  MAX  CROSSWINDS  10-19  MPH  DAYS 

El 9  =  MAX  CROSSWINDS  20-29  MPH  DAYS 

E20  =  MAX  CROSSWINDS  30-39  MPH  DAYS 

E27  =  MIN  TEMP.  BELOW  32°F  DAYS 

E30  =  AVG.  VISION  OBSTRUCTION  TYPE 

E31  =  AVG.  OBSTRUCTION  SEVERITY 

E07  =  TOTAL  SNOW  FALL 

E24  =  MEAN  MIN.  TEMP. 

E06  =  NO.  OF  SNOW  DAYS 

E08  =  MEAN  SNOW  DEPTH 

El 6  =  PREDOMINATE  WIND  DIRECTION 

E21  =  MAX.  CROSSWINDS  40-49  MPH  DAYS 
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APPENDIX  F 


LOOM  FAILURE  CLOCK 
CALCULATION  WORKSHEET 


EXAMPLE  OF  FAILURE  CLOCK 
TRANSFORMATION  ROUTINE 
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LCOM  FAILURE  CLOCK  CALCULATION  WORKSHEET 


EXAMPLE  OF  FAILURE  CLOCK  TRANSFORMATION  PROCEDURE: 

Assume  that  there  exists  a  failure  dock  for  the  F-15A  flight 
Indicators  Subsystem  (WUC-51A)  which  is  based  on  1977  maintenance  demand 
and  sortie  data  from  Bitburg  Air  Base. 

Step  1  Derivation  time  period  *  1977 

Step  2  Actual  maint.  action  demand  (AMAD)  for  WUC-51A: 

(LCOM  definition  AMAD  per  system  per  year) 

(Source:  AfM  66-1  (D056E)  data  for  1977) 

LOOM  Task  Code  R  *  46  actions/32  systems  *  1.43760 

LCOM  Task  Code  M  *  20  actions/32  systems  »  0.62500 

LCOM  Task  Code  H  »  11  actions/32  systems  »  0.3437S 

Total  1677  AMAD  (LCOM  Definition)  2.40625 

Step  3  1977  values  for  significant  F-15A  (WUC-S1A)  Maintenance  Metrics 

Regression  Model  variables  (Bitburg  data): 


Equipment  Variables: 

A03.  Equipment  Weight . 0.72  lbs. 

Operations  Variables: 

013,  Minimum  tanding  Distance . 3750.00  feet 

017,  Operations  Flying  Hours  per  Aircraft  .  223.53  hrs./yr. 
Environmental  Variables: 

E03,  Runway  Direction  .  240.00  compass 

degree 

£19,  Maximum  Crosswinds  20-29  mph  .  106.00  days/yr. 


Step  4  Estimated  maint.  action  demand  (EMAD)  for  WUC-51A: 

(F-15A  Bitburg  Situation,  1977) 

WUC-51A  Maint.  Metrics  Regress  Model: 

(Derived  from  data  for  WUCs  SlAD,  51AH,  and  51AK) 

EMAO  »  4.65791+(0 .3981 3) (0.72)+(0. 00036) (3750.0)+. . . 

_ +(0.001 59) (223. 53) -(0.00361 ) (240. 0)+( 0.04497) (106.0) 

EMAD  (for  SlAD,  51AH,  51AK)  *  1 .23458  actions  per  year 

AMAD  (for  51A0,  51AH,  51AK)  *  0.88  actions  per  yr  (from  66-1  data) 

Ratio  of  total  51A  AMAO  to  partial  AMAD  above: 

2.40625/0.88  -  2.73 

Total  51A  EMAD  *  (2.73)0.23458)  •  3.376 

Step  5  Ratio  of  total  WUC-51A  EMAO  to  AMAO 
3.376/2.406  »  1.403 

Step  6  Calculation  and  transformation  of  baseline  failure  clock  value: 

\ 

Assume  that  the  baseline  WUC-51  failure  clock  value  is  based  on 
sorties  per  failure  for  the  year  1977  with  no  allowance  for 
peak  sortie  rate  or  peak  failure  rate  periods. 

Then--Sorties  per  failure  ■  Total  Sorties  per  Acft/Total  AMAD 

per  unit 

-  174.53/2.406 

«  72.54 

Set  baseline  F-clock  at  73  sorties  to  failure 

Transformed  f-clock  value  *  (AMAD/EMAD)  (Baseline  Clock  Value) 

-  (1.403K72.S4) 

«  101.77 

Set  new  f-clock  value  at  102  sorties  to  failure  by  adding  a 
clock  change  card  to  the  LCOM  control  deck  designating  the 
appropriate  clock  number  and  the  new  clock  value. 
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